Aug 26 11:52:54 devstack cinder-volume[82895]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 11:52:54 devstack cinder-volume[82895]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 11:52:54 devstack cinder-volume[82895]: we strongly recommend against using it for new projects. Aug 26 11:52:54 devstack cinder-volume[82895]: If you are already using Eventlet, we recommend migrating to a different Aug 26 11:52:54 devstack cinder-volume[82895]: framework. For more detail see Aug 26 11:52:54 devstack cinder-volume[82895]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 11:52:54 devstack cinder-volume[82895]: import eventlet # noqa Aug 26 11:52:56 devstack cinder-volume[82895]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 11:52:56 devstack cinder-volume[82895]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 11:52:56 devstack cinder-volume[82895]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 11:52:57 devstack cinder-volume[82895]: INFO dbcounter [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Registered counter for database cinder Aug 26 11:52:58 devstack cinder-volume[82895]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:52:58 devstack cinder-volume[82895]: DEBUG dbcounter [-] [82895] Writer thread running {{(pid=82895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 11:52:58 devstack cinder-volume[82895]: INFO cinder.rpc [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 11:52:58 devstack cinder-volume[82895]: INFO cinder.rpc [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 11:52:58 devstack cinder-volume[82895]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:52:58 devstack cinder-volume[82895]: INFO cinder.volume.manager [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Determined volume DB was empty at startup. Aug 26 11:52:58 devstack cinder-volume[82895]: DEBUG cinder.volume.manager [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82895) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 11:52:58 devstack cinder-volume[82895]: INFO cinder.volume.manager [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 11:52:58 devstack cinder-volume[82895]: WARNING stevedore.named [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 11:52:58 devstack cinder-volume[82895]: WARNING castellan.key_manager [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 11:52:58 devstack cinder-volume[82895]: WARNING cinder.keymgr.conf_key_mgr [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 11:52:58 devstack cinder-volume[82895]: DEBUG cinder.volume.drivers.lvm [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82895) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 26 11:52:58 devstack cinder-volume[82895]: DEBUG oslo_concurrency.processutils [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_concurrency.processutils [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] CMD "cinder-rtstool verify" returned: 0 in 0.408s {{(pid=82895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:52:59 devstack cinder-volume[82895]: INFO cinder.rpc [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 26 11:52:59 devstack cinder-volume[82895]: INFO cinder.rpc [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 26 11:52:59 devstack cinder-volume[82895]: WARNING stevedore.named [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 11:52:59 devstack cinder-volume[82895]: WARNING castellan.key_manager [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 11:52:59 devstack cinder-volume[82895]: INFO cinder.volume.manager [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:52:59 devstack cinder-volume[82895]: INFO oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Starting 1 workers Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Started child 83050 {{(pid=82895) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Full set of CONF: {{(pid=82895) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] ******************************************************************************** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Configuration options gathered from: {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] ================================================================================ {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] allow_availability_zone_fallback = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] allow_compression_on_image_upload = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] allowed_direct_url_schemes = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] api_rate_limit = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] auth_strategy = keystone {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] az_cache_duration = 3600 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_availability_zone = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_host = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_stats_polling_interval = 60 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backup_api_class = cinder.backup.api.API {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backup_name_template = backup-%s {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backup_use_same_host = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backup_use_temp_snapshot = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] chap_password = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] chap_username = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cinder_internal_tenant_project_id = bf2023d296704ad59507ac1a4b33aaf1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cinder_internal_tenant_user_id = 8424e8a9818a4e57aeddaad239bcfc64 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cloned_volume_same_az = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cluster = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] compression_format = gzip {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] compute_api_class = cinder.compute.nova.API {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] config_dir = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] config_source = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] control_exchange = openstack {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] debug = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] default_availability_zone = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] default_group_type = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] default_volume_type = lvmdriver-1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] disk_geometry = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] driver_client_cert = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] driver_client_cert_key = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] driver_data_namespace = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[83050]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] driver_ssl_cert_path = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] driver_ssl_cert_verify = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] driver_use_ssl = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] enable_force_upload = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] enable_new_services = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] enable_unsupported_driver = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] enforce_multipath_for_image_xfer = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] filter_function = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_api_insecure = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_api_servers = ['http://192.168.122.122/image'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_api_ssl_compression = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_ca_certificates_file = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_catalog_info = image:glance:publicURL {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_certfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_keyfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_num_retries = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance_request_timeout = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] goodness_function = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] graceful_shutdown_timeout = 5 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] group_api_class = cinder.group.api.API {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] host = devstack {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_compress_on_upload = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_conversion_address_space_limit = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_conversion_cpu_limit = 60 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_conversion_disable = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_upload_use_cinder_backend = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_upload_use_internal_tenant = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_volume_cache_enabled = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_volume_cache_max_count = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] image_volume_cache_max_size_gb = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] init_host_max_objects_retrieval = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] instance_format = [instance: %(uuid)s] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] iscsi_target_flags = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] iscsi_write_cache = on {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] iser_helper = tgtadm {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] iser_ip_address = 192.168.122.122 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] iser_port = 3260 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] log_color = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] log_config_append = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] log_dir = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] log_file = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] log_options = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] log_rotate_interval = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] log_rotate_interval_type = days {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] log_rotation_type = none {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] max_age = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] max_logfile_count = 30 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] max_logfile_size_mb = 200 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] max_over_subscription_ratio = 20.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] message_reap_interval = 86400 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] message_ttl = 2592000 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] migration_create_volume_timeout_secs = 300 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] monkey_patch = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] monkey_patch_modules = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] my_ip = 192.168.122.122 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] no_snapshot_gb_quota = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] num_iser_scan_tries = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] num_shell_tries = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] num_volume_device_scan_tries = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] nvmeof_conn_info_version = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] nvmet_ns_id = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] nvmet_port_id = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] osapi_max_limit = 1000 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] osapi_volume_ext_list = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] osapi_volume_listen_port = 8776 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] osapi_volume_use_ssl = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] osapi_volume_workers = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] per_volume_size_limit = -1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] periodic_fuzzy_delay = 60 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] periodic_interval = 60 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] public_endpoint = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] publish_errors = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] quota_backup_gigabytes = 1000 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] quota_backups = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] quota_gigabytes = 1000 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] quota_groups = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] quota_snapshots = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] quota_volumes = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] rate_limit_burst = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] rate_limit_except_level = CRITICAL {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] rate_limit_interval = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] reinit_driver_count = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] replication_device = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] report_discard_supported = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] report_interval = 120 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] reservation_clean_interval = 86400 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] reservation_expire = 86400 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] reserved_image_namespaces = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] reserved_percentage = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] rpc_response_timeout = 120 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] run_external_periodic_tasks = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] scst_target_driver = iscsi {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] scst_target_iqn_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_down_time = 720 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] shell_completion = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] snapshot_name_template = snapshot-%s {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] snapshot_same_host = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] split_loggers = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] state_path = /opt/stack/data/cinder {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] storage_availability_zone = nova {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] storage_protocol = iSCSI {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] syslog_log_facility = LOG_USER {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] target_helper = lioadm {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] target_ip_address = 192.168.122.122 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] target_port = 3260 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[83050]: INFO cinder.volume.manager [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] target_protocol = iscsi {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] target_secondary_ip_addresses = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] trace_flags = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] transport_url = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] until_refresh = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] use_chap_auth = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] use_default_quota_class = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] use_journal = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] use_json = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] use_multipath_for_image_xfer = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] use_stderr = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] use_syslog = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] verify_glance_signatures = enabled {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_api_class = cinder.volume.api.API {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_backend_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_clear = zero {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_clear_ionice = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_clear_size = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_copy_bps_limit = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_dd_blocksize = 1M {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_name_template = volume-%s {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_service_inithost_offload = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volume_usage_audit_period = month {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] zoning_mode = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_concurrency.disable_process_locking = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.auth_section = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.auth_type = password {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.auth_version = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.cache = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.certfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.include_service_catalog = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.insecure = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.interface = public {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.keyfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_password = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcache_username = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.region_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.service_type = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.122/identity {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.backend = dogpile.cache.null {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.backend_argument = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.backend_expiration_time = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.config_prefix = cache.oslo {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.debug_cache_backend = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.enable_retry_client = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.enable_socket_keepalive = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.enabled = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.expiration_time = 600 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.hashclient_retry_attempts = 2 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.memcache_dead_retry = 300 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.memcache_pool_maxsize = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.memcache_sasl_enabled = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.password = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.proxies = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.redis_db = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.redis_server = localhost:6379 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.retry_attempts = 2 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.retry_delay = 0.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.socket_keepalive_count = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.socket_keepalive_idle = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.socket_keepalive_interval = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.socket_timeout = 1.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.tls_allowed_ciphers = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.tls_cafile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.tls_certfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.tls_enabled = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.tls_keyfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cache.username = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] coordination.backend_url = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.asyncio_connection = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.asyncio_slave_connection = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.backend = sqlalchemy {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.connection = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.connection_debug = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.connection_parameters = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.connection_recycle_time = 3600 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.connection_trace = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.db_inc_retry_interval = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.db_max_retries = 20 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.db_max_retry_interval = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.db_retry_interval = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.max_overflow = 50 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.max_pool_size = 5 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.max_retries = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.mysql_wsrep_sync_wait = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.pool_timeout = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.retry_interval = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.slave_connection = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.sqlite_synchronous = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.synchronous_reader = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:52:59 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] database.use_db_reconnect = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.connection_string = messaging:// {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.enabled = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.es_doc_type = notification {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.es_scroll_size = 10000 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.es_scroll_time = 2m {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.filter_error_trace = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.hmac_keys = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.sentinel_service_name = mymaster {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.socket_timeout = 0.1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.trace_requests = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler.trace_sqlalchemy = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler_jaeger.process_tags = {} {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler_jaeger.service_name_prefix = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] profiler_otlp.service_name_prefix = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.enforce_new_defaults = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.policy_default_rule = default {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.policy_file = policy.yaml {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] privsep_osbrick.group = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] privsep_osbrick.helper_command = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] privsep_osbrick.user = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cinder_sys_admin.group = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cinder_sys_admin.helper_command = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] cinder_sys_admin.user = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.auth_section = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.auth_type = password {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.cafile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.certfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.collect_timing = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.insecure = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.keyfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.send_service_user_token = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.split_loggers = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] service_user.timeout = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.auth_section = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.auth_type = password {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.certfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.collect_timing = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.insecure = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.keyfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.region_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.split_loggers = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] glance.timeout = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.backend_availability_zone = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.chap_password = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.chap_username = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.disk_geometry = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.driver_client_cert = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.driver_client_cert_key = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.driver_data_namespace = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.driver_use_ssl = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.extra_capabilities = {} {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.filter_function = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.goodness_function = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.iscsi_target_flags = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.iscsi_write_cache = on {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.iser_helper = tgtadm {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.iser_ip_address = 192.168.122.122 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.iser_port = 3260 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.lvm_share_target = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.lvm_type = auto {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.num_shell_tries = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.replication_device = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.report_discard_supported = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.reserved_percentage = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.target_helper = tgtadm {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.target_ip_address = 192.168.122.122 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.target_port = 3260 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.target_protocol = iscsi {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.trace_flags = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.unique_fqdn_network = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.use_chap_auth = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volume_backend_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volume_clear = zero {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volume_clear_ionice = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volume_clear_size = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_reports.file_event_handler = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_reports.log_dir = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.backend_host = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack sudo[83058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.chap_password = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.chap_username = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.disk_geometry = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.driver_client_cert = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.extra_capabilities = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.filter_function = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.goodness_function = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack sudo[83058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.iser_helper = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.iser_ip_address = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.iser_port = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.lvm_share_target = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.lvm_type = auto {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.num_shell_tries = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.replication_device = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.report_discard_supported = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.reserved_percentage = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.scst_target_driver = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.storage_protocol = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.target_helper = lioadm {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.target_ip_address = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.target_port = 3260 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.trace_flags = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.use_chap_auth = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volume_clear = zero {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volume_clear_size = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] lvmdriver-1.volumes_dir = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.ssl = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_notifications.driver = [] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_notifications.retry = -1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] key_manager.fixed_key = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.barbican_api_version = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.barbican_endpoint = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.barbican_endpoint_type = public {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.barbican_region_name = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.cafile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.certfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.collect_timing = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.insecure = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.keyfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.number_of_retries = 60 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.retry_delay = 1 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.send_service_user_token = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.split_loggers = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.timeout = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.verify_ssl = True {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican.verify_ssl_path = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican_service_user.auth_section = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican_service_user.auth_type = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican_service_user.cafile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican_service_user.certfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican_service_user.collect_timing = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican_service_user.insecure = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican_service_user.keyfile = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican_service_user.split_loggers = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] barbican_service_user.timeout = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.approle_role_id = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.approle_secret_id = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.auth_method = approle {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.auth_path = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.kv_mountpoint = secret {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.kv_path = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.kv_version = 2 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.namespace = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.root_token_id = **** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.ssl_ca_crt_file = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.timeout = 60.0 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.token_file = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.token_role = None {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.use_ssl = False {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:52:59 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] ******************************************************************************** {{(pid=82895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 11:52:59 devstack sudo[83058]: pam_unix(sudo:session): session closed for user root Aug 26 11:52:59 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:52:59 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:00 devstack sudo[83179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:53:00 devstack sudo[83179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:00 devstack sudo[83179]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:00 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.303s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:00 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 11:53:00 devstack cinder-volume[83050]: INFO cinder.brick.local_dev.lvm [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 26 11:53:00 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:00 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:00 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:00 devstack sudo[83282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:53:00 devstack sudo[83282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:00 devstack sudo[83282]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:00 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:00 devstack cinder-volume[83050]: DEBUG cinder.brick.local_dev.lvm [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83050) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 26 11:53:00 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:00 devstack sudo[83366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:53:00 devstack sudo[83366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:01 devstack sudo[83366]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:01 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:53:01 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:01 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:01 devstack sudo[83666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 26 11:53:01 devstack sudo[83666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:01 devstack sudo[83666]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.285s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:01 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:01 devstack sudo[83669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:53:01 devstack sudo[83669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:02 devstack sudo[83669]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:02 devstack sudo[83753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:53:02 devstack sudo[83753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:02 devstack sudo[83753]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:02 devstack sudo[83756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:53:02 devstack sudo[83756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:02 devstack sudo[83756]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:02 devstack sudo[83775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:53:02 devstack sudo[83775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:02 devstack sudo[83775]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.326s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:02 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:02 devstack sudo[83855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:53:02 devstack sudo[83855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:03 devstack sudo[83855]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:03 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:03 devstack cinder-volume[83050]: INFO cinder.volume.drivers.lvm [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 26 11:53:03 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:03 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:03 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:03 devstack sudo[83859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:53:03 devstack sudo[83859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:03 devstack sudo[83859]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:03 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:03 devstack cinder-volume[83050]: DEBUG cinder.volume.drivers.lvm [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Updating volume stats {{(pid=83050) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 11:53:03 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:03 devstack sudo[83862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:53:03 devstack sudo[83862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:03 devstack sudo[83862]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:03 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:03 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:03 devstack sudo[83865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:53:03 devstack sudo[83865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:04 devstack sudo[83865]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:04 devstack sudo[83868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:53:04 devstack sudo[83868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:04 devstack sudo[83868]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:04 devstack sudo[83871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:53:04 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:04 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:04 devstack cinder-volume[83050]: INFO cinder.volume.driver [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Driver hasn't implemented _init_vendor_properties() Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG cinder.volume.driver [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83050) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG oslo_db.sqlalchemy.engines [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83050) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG dbcounter [-] [83050] Writer thread running {{(pid=83050) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG cinder.db.api [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Building query based on filter {{(pid=83050) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG cinder.image.image_utils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83050) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 11:53:04 devstack cinder-volume[83050]: INFO cinder.keymgr.migration [None req-38058e45-1ce4-415d-96ad-b8b77de2bd47 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG cinder.volume.drivers.lvm [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Updating volume stats {{(pid=83050) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 11:53:04 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:04 devstack sudo[83875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:53:04 devstack sudo[83875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:04 devstack sudo[83875]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:05 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:53:05 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:05 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:05 devstack sudo[83884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:53:05 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:05 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:05 devstack sudo[83887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:53:05 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:05 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG cinder.manager [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Notifying Schedulers of capabilities ... {{(pid=83050) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:53:05 devstack cinder-volume[83050]: INFO cinder.volume.manager [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Driver initialization completed successfully. Aug 26 11:53:05 devstack cinder-volume[83050]: INFO cinder.manager [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Initiating service 2 cleanup Aug 26 11:53:05 devstack cinder-volume[83050]: INFO cinder.manager [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Service 2 cleanup completed. Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG cinder.service [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Creating RPC server for service cinder-volume {{(pid=83050) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG cinder.service [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83050) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 11:53:05 devstack cinder-volume[83050]: INFO cinder.volume.manager [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG cinder.volume.drivers.lvm [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Updating volume stats {{(pid=83050) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 11:53:05 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:05 devstack sudo[83890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:53:05 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:06 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:06 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:06 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:06 devstack sudo[83896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:53:06 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:06 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:06 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:06 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:06 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:53:06 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:06 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:06 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:06 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:53:06 devstack sudo[83904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:53:06 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:53:07 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root Aug 26 11:53:07 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:53:07 devstack cinder-volume[83050]: INFO cinder.volume.manager [None req-3587ee39-c4e2-454c-91ad-b3622f4d5eac None None] Driver post RPC initialization completed successfully. Aug 26 11:53:09 devstack cinder-volume[82895]: DEBUG dbcounter [-] [82895] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:53:15 devstack cinder-volume[83050]: DEBUG dbcounter [-] [83050] Writing DB stats cinder:SELECT=3 {{(pid=83050) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:53:17 devstack cinder-volume[83050]: DEBUG dbcounter [-] [83050] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83050) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:53:21 devstack cinder-volume[83050]: DEBUG oslo_service.periodic_task [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running periodic task VolumeManager._thread_info {{(pid=83050) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:53:21 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread count: 6 {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 11:53:21 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread info: [<_MainThread(MainThread, started 124875527340160)>, , , , , ] {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 11:54:21 devstack cinder-volume[83050]: DEBUG oslo_service.periodic_task [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83050) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:54:21 devstack cinder-volume[83050]: DEBUG cinder.volume.drivers.lvm [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Updating volume stats {{(pid=83050) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 11:54:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:54:21 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:54:21 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:54:21 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Aug 26 11:54:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:54:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:54:21 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:54:21 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:54:21 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Aug 26 11:54:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:54:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:54:21 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:54:21 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:54:21 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Aug 26 11:54:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:54:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:54:21 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:54:21 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:54:22 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Aug 26 11:54:22 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:54:22 devstack cinder-volume[83050]: DEBUG cinder.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Notifying Schedulers of capabilities ... {{(pid=83050) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:54:22 devstack cinder-volume[83050]: DEBUG oslo_service.periodic_task [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running periodic task VolumeManager._thread_info {{(pid=83050) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:54:22 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread count: 6 {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 11:54:22 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread info: [<_MainThread(MainThread, started 124875527340160)>, , , , , ] {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 11:55:17 devstack cinder-volume[83050]: DEBUG dbcounter [-] [83050] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83050) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:55:21 devstack cinder-volume[83050]: DEBUG oslo_service.periodic_task [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83050) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:55:21 devstack cinder-volume[83050]: DEBUG cinder.volume.drivers.lvm [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Updating volume stats {{(pid=83050) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 11:55:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:55:21 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:55:21 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:55:21 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Aug 26 11:55:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:55:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:55:21 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:55:21 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:55:21 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Aug 26 11:55:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:55:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:55:21 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:55:21 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:55:21 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Aug 26 11:55:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:55:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:55:21 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:55:21 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:55:22 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Aug 26 11:55:22 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:55:22 devstack cinder-volume[83050]: DEBUG cinder.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Notifying Schedulers of capabilities ... {{(pid=83050) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:55:22 devstack cinder-volume[83050]: DEBUG oslo_service.periodic_task [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running periodic task VolumeManager._thread_info {{(pid=83050) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:55:22 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread count: 6 {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 11:55:22 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread info: [<_MainThread(MainThread, started 124875527340160)>, , , , , ] {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 11:56:21 devstack cinder-volume[83050]: DEBUG oslo_service.periodic_task [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83050) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:56:21 devstack cinder-volume[83050]: DEBUG cinder.volume.drivers.lvm [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Updating volume stats {{(pid=83050) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 11:56:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:56:21 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:56:21 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:56:21 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Aug 26 11:56:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:56:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:56:21 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:56:21 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:56:21 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Aug 26 11:56:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:56:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:56:21 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:56:21 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:56:21 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Aug 26 11:56:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:56:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:56:21 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:56:21 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:56:22 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Aug 26 11:56:22 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:56:22 devstack cinder-volume[83050]: DEBUG cinder.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Notifying Schedulers of capabilities ... {{(pid=83050) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:56:22 devstack cinder-volume[83050]: DEBUG oslo_service.periodic_task [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running periodic task VolumeManager._thread_info {{(pid=83050) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:56:22 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread count: 6 {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 11:56:22 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread info: [<_MainThread(MainThread, started 124875527340160)>, , , , , ] {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 11:57:17 devstack cinder-volume[83050]: DEBUG dbcounter [-] [83050] Writing DB stats cinder:SELECT=1 {{(pid=83050) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:57:17 devstack cinder-volume[83050]: DEBUG dbcounter [-] [83050] Writing DB stats cinder:UPDATE=1 {{(pid=83050) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:57:21 devstack cinder-volume[83050]: DEBUG oslo_service.periodic_task [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83050) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:57:21 devstack cinder-volume[83050]: DEBUG cinder.volume.drivers.lvm [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Updating volume stats {{(pid=83050) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 11:57:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:21 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 11:57:21 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:21 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:21 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:57:21 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:21 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:21 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 11:57:21 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:21 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:21 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:21 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 11:57:21 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:22 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:22 devstack cinder-volume[83050]: DEBUG oslo_concurrency.processutils [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83050) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:22 devstack cinder-volume[83050]: DEBUG cinder.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Notifying Schedulers of capabilities ... {{(pid=83050) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:57:22 devstack cinder-volume[83050]: DEBUG oslo_service.periodic_task [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] Running periodic task VolumeManager._thread_info {{(pid=83050) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:57:22 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread count: 6 {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 11:57:22 devstack cinder-volume[83050]: DEBUG cinder.volume.manager [None req-693beea7-f891-4108-ad6d-451627c9a9c6 None None] thread info: [<_MainThread(MainThread, started 124875527340160)>, , , , , ] {{(pid=83050) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 11:57:27 devstack cinder-volume[82895]: INFO oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Caught SIGTERM, stopping children Aug 26 11:57:27 devstack cinder-volume[82895]: DEBUG oslo_concurrency.lockutils [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Acquiring lock "singleton_lock" {{(pid=82895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 11:57:27 devstack cinder-volume[82895]: DEBUG oslo_concurrency.lockutils [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Acquired lock "singleton_lock" {{(pid=82895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 11:57:27 devstack cinder-volume[82895]: DEBUG oslo_concurrency.lockutils [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Releasing lock "singleton_lock" {{(pid=82895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 11:57:27 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Stop services. {{(pid=82895) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 11:57:27 devstack cinder-volume[82895]: DEBUG oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Killing children. {{(pid=82895) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 11:57:27 devstack cinder-volume[82895]: INFO oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Waiting on 1 children to exit Aug 26 11:57:30 devstack cinder-volume[83050]: DEBUG oslo_concurrency.lockutils [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Acquiring lock "singleton_lock" {{(pid=83050) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 11:57:30 devstack cinder-volume[83050]: DEBUG oslo_concurrency.lockutils [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Acquired lock "singleton_lock" {{(pid=83050) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 11:57:30 devstack cinder-volume[83050]: DEBUG oslo_concurrency.lockutils [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Releasing lock "singleton_lock" {{(pid=83050) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 11:57:30 devstack cinder-volume[83050]: WARNING amqp [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 11:57:30 devstack cinder-volume[83050]: WARNING amqp [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 11:57:30 devstack cinder-volume[82895]: INFO oslo_service.backend._eventlet.service [None req-8a02be4c-f66d-4352-87a2-e314b9ac5083 None None] Child 83050 exited with status 0 Aug 26 11:57:31 devstack cinder-volume[93585]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 11:57:31 devstack cinder-volume[93585]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 11:57:31 devstack cinder-volume[93585]: we strongly recommend against using it for new projects. Aug 26 11:57:31 devstack cinder-volume[93585]: If you are already using Eventlet, we recommend migrating to a different Aug 26 11:57:31 devstack cinder-volume[93585]: framework. For more detail see Aug 26 11:57:31 devstack cinder-volume[93585]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 11:57:31 devstack cinder-volume[93585]: import eventlet # noqa Aug 26 11:57:33 devstack cinder-volume[93585]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 11:57:33 devstack cinder-volume[93585]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 11:57:33 devstack cinder-volume[93585]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 11:57:34 devstack cinder-volume[93585]: INFO dbcounter [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Registered counter for database cinder Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_db.sqlalchemy.engines [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG dbcounter [-] [93585] Writer thread running {{(pid=93585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 11:57:34 devstack cinder-volume[93585]: INFO cinder.rpc [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 11:57:34 devstack cinder-volume[93585]: INFO cinder.rpc [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_db.sqlalchemy.engines [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:57:34 devstack cinder-volume[93585]: INFO cinder.volume.manager [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Determined volume DB was empty at startup. Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG cinder.volume.manager [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93585) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 11:57:34 devstack cinder-volume[93585]: INFO cinder.volume.manager [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 11:57:34 devstack cinder-volume[93585]: WARNING stevedore.named [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 11:57:34 devstack cinder-volume[93585]: WARNING castellan.key_manager [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 11:57:34 devstack cinder-volume[93585]: WARNING cinder.keymgr.conf_key_mgr [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 11:57:34 devstack cinder-volume[93585]: INFO cinder.volume.manager [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_db.sqlalchemy.engines [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:57:34 devstack cinder-volume[93585]: INFO oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Starting 1 workers Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Started child 93802 {{(pid=93585) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Full set of CONF: {{(pid=93585) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] ******************************************************************************** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Configuration options gathered from: {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 11:57:34 devstack cinder-volume[93802]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] ================================================================================ {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] allow_availability_zone_fallback = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] allow_compression_on_image_upload = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] allowed_direct_url_schemes = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] api_rate_limit = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] auth_strategy = keystone {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_availability_zone = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_host = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_stats_polling_interval = 60 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backup_api_class = cinder.backup.api.API {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backup_name_template = backup-%s {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backup_use_same_host = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backup_use_temp_snapshot = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] chap_password = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] chap_username = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cinder_internal_tenant_project_id = bf2023d296704ad59507ac1a4b33aaf1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cinder_internal_tenant_user_id = 8424e8a9818a4e57aeddaad239bcfc64 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cluster = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] compression_format = gzip {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] compute_api_class = cinder.compute.nova.API {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] config_dir = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] config_source = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] control_exchange = openstack {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] debug = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] default_availability_zone = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] default_group_type = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] default_volume_type = QuobyteHD {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] disk_geometry = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] driver_client_cert = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] driver_client_cert_key = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] driver_data_namespace = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] driver_ssl_cert_path = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] driver_ssl_cert_verify = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] driver_use_ssl = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] enable_new_services = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] enable_unsupported_driver = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] enabled_backends = ['QuobyteHD'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] enforce_multipath_for_image_xfer = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] filter_function = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_api_insecure = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_api_servers = ['http://192.168.122.122/image'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_api_ssl_compression = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_ca_certificates_file = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_catalog_info = image:glance:publicURL {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_certfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_keyfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_num_retries = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance_request_timeout = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] goodness_function = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] graceful_shutdown_timeout = 5 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] group_api_class = cinder.group.api.API {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] host = devstack {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_compress_on_upload = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_conversion_address_space_limit = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_conversion_cpu_limit = 60 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_conversion_disable = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_upload_use_cinder_backend = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_upload_use_internal_tenant = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_volume_cache_enabled = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_volume_cache_max_count = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] image_volume_cache_max_size_gb = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] init_host_max_objects_retrieval = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] instance_format = [instance: %(uuid)s] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] iscsi_target_flags = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] iscsi_write_cache = on {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] iser_helper = tgtadm {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] iser_ip_address = 192.168.122.122 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] iser_port = 3260 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] log_color = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] log_config_append = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93802]: INFO cinder.volume.manager [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 11:57:34 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.remotefs [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93802) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] log_dir = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] log_file = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] log_options = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] log_rotate_interval = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] log_rotate_interval_type = days {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] log_rotation_type = none {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] max_age = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] max_logfile_count = 30 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] max_logfile_size_mb = 200 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] max_over_subscription_ratio = 20.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] message_reap_interval = 86400 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] message_ttl = 2592000 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] migration_create_volume_timeout_secs = 300 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] monkey_patch = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] monkey_patch_modules = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] my_ip = 192.168.122.122 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] no_snapshot_gb_quota = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] num_iser_scan_tries = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] num_shell_tries = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] num_volume_device_scan_tries = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] nvmeof_conn_info_version = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] nvmet_ns_id = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] nvmet_port_id = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] osapi_max_limit = 1000 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] osapi_volume_ext_list = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] osapi_volume_listen = 0.0.0.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] osapi_volume_listen_port = 8776 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] osapi_volume_use_ssl = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] osapi_volume_workers = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] per_volume_size_limit = -1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] periodic_fuzzy_delay = 60 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] periodic_interval = 60 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] project_id_regex = [0-9a-f\-]+ {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] public_endpoint = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] publish_errors = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] quota_backup_gigabytes = 1000 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] quota_backups = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] quota_gigabytes = 1000 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] quota_groups = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] quota_snapshots = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] quota_volumes = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] rate_limit_burst = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] rate_limit_except_level = CRITICAL {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] rate_limit_interval = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] reinit_driver_count = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] replication_device = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] report_discard_supported = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] report_interval = 120 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] reservation_clean_interval = 86400 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] reservation_expire = 86400 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] reserved_image_namespaces = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] reserved_percentage = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] rpc_response_timeout = 120 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] run_external_periodic_tasks = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] scst_target_driver = iscsi {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] scst_target_iqn_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_down_time = 720 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] shell_completion = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] snapshot_name_template = snapshot-%s {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] split_loggers = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] state_path = /opt/stack/data/cinder {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] storage_availability_zone = nova {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] storage_protocol = iSCSI {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] syslog_log_facility = LOG_USER {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] target_helper = lioadm {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] target_ip_address = 192.168.122.122 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] target_port = 3260 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] target_protocol = iscsi {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] target_secondary_ip_addresses = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] trace_flags = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] transfer_api_class = cinder.transfer.api.API {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] transport_url = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] until_refresh = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] use_chap_auth = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] use_default_quota_class = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] use_journal = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] use_json = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] use_multipath_for_image_xfer = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] use_stderr = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] use_syslog = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] verify_glance_signatures = enabled {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_api_class = cinder.volume.api.API {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_backend_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_clear = zero {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_clear_ionice = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_clear_size = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_copy_bps_limit = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_dd_blocksize = 1M {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_name_template = volume-%s {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_service_inithost_offload = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volume_usage_audit_period = month {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] zoning_mode = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_concurrency.disable_process_locking = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.auth_section = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.auth_type = password {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.auth_version = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.cache = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.certfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.delay_auth_decision = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.http_connect_timeout = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.include_service_catalog = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.insecure = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.interface = public {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.keyfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_password = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcache_username = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.region_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.service_token_roles_required = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.service_type = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.token_cache_time = 300 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.122/identity {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.backend = dogpile.cache.null {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.backend_argument = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.backend_expiration_time = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.config_prefix = cache.oslo {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.debug_cache_backend = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.enable_retry_client = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.enable_socket_keepalive = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.enabled = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.expiration_time = 600 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.hashclient_retry_attempts = 2 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.memcache_dead_retry = 300 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.memcache_pool_maxsize = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.memcache_sasl_enabled = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.password = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.proxies = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.redis_db = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.redis_sentinel_service_name = mymaster {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.redis_server = localhost:6379 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.retry_attempts = 2 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.retry_delay = 0.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.socket_keepalive_count = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.socket_keepalive_idle = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.socket_keepalive_interval = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.socket_timeout = 1.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.tls_allowed_ciphers = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.tls_cafile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.tls_certfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.tls_enabled = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.tls_keyfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cache.username = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:34 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] coordination.backend_url = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.asyncio_connection = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.asyncio_slave_connection = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.backend = sqlalchemy {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.connection = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.connection_debug = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.connection_parameters = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.connection_recycle_time = 3600 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.connection_trace = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.db_inc_retry_interval = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.db_max_retries = 20 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.db_max_retry_interval = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.db_retry_interval = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.max_overflow = 50 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.max_pool_size = 5 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.max_retries = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.mysql_wsrep_sync_wait = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.pool_timeout = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.retry_interval = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.slave_connection = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.sqlite_synchronous = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.synchronous_reader = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] database.use_db_reconnect = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.connection_string = messaging:// {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.enabled = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.es_doc_type = notification {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.es_scroll_size = 10000 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.es_scroll_time = 2m {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.filter_error_trace = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.hmac_keys = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.sentinel_service_name = mymaster {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.socket_timeout = 0.1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.trace_requests = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler.trace_sqlalchemy = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler_jaeger.process_tags = {} {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler_jaeger.service_name_prefix = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] profiler_otlp.service_name_prefix = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.enforce_new_defaults = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93802) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 11:57:35 devstack cinder-volume[93802]: WARNING cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 11:57:35 devstack cinder-volume[93802]: WARNING cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.policy_default_rule = default {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Running cmd (subprocess): mount.quobyte {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.policy_file = policy.yaml {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_policy.remote_timeout = 60.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] privsep_osbrick.group = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] privsep_osbrick.helper_command = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] privsep_osbrick.user = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cinder_sys_admin.group = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cinder_sys_admin.helper_command = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] cinder_sys_admin.user = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.auth_section = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.auth_type = password {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.cafile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.certfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.collect_timing = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.insecure = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.keyfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.send_service_user_token = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.split_loggers = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] service_user.timeout = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.auth_section = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.auth_type = password {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.certfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.collect_timing = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.insecure = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.keyfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.region_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.split_loggers = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] glance.timeout = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.backend_availability_zone = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.chap_password = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.chap_username = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.disk_geometry = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.driver_client_cert = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.driver_client_cert_key = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.driver_data_namespace = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.driver_use_ssl = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.enable_unsupported_driver = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.extra_capabilities = {} {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.filter_function = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.goodness_function = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.iscsi_target_flags = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.iscsi_write_cache = on {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.iser_helper = tgtadm {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.iser_ip_address = 192.168.122.122 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.iser_port = 3260 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_host = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_login = admin {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_mount_options = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_password = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_private_key = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_share_path = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_ssh_port = 22 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.num_shell_tries = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.nvmet_port_id = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.quobyte_client_cfg = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.quobyte_volume_url = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.replication_device = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.report_discard_supported = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.reserved_percentage = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.scst_target_driver = iscsi {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack quobyte-client[93807]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.scst_target_iqn_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.storage_protocol = iSCSI {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.target_helper = tgtadm {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.target_ip_address = 192.168.122.122 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.target_port = 3260 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack quobyte-client[93807]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.target_protocol = iscsi {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.trace_flags = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.unique_fqdn_network = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.use_chap_auth = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.volume_backend_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.volume_clear = zero {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.volume_clear_ionice = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.volume_clear_size = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_reports.file_event_handler = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_reports.log_dir = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.backend_availability_zone = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.backend_host = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.chap_password = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.chap_username = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.chiscsi_conf = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.disk_geometry = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.driver_client_cert = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.driver_client_cert_key = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.driver_data_namespace = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.driver_use_ssl = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.extra_capabilities = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.filter_function = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.goodness_function = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=93802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.iscsi_target_flags = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.iscsi_write_cache = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.iser_helper = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.iser_ip_address = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.iser_port = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.iser_target_prefix = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_host = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_login = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_mount_options = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93802]: INFO cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d ... Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_password = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_private_key = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_share_path = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 -c /etc/quobyte/client-cinder.cfg {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_ssh_port = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.num_shell_tries = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nvmet_ns_id = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.nvmet_port_id = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.replication_device = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.report_discard_supported = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.reserved_percentage = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.scst_target_driver = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.storage_protocol = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.target_helper = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.target_ip_address = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.target_port = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.target_prefix = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.target_protocol = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.trace_flags = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.unique_fqdn_network = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.use_chap_auth = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.volume_clear = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.volume_clear_ionice = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.volume_clear_size = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] QuobyteHD.volumes_dir = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 -c /etc/quobyte/client-cinder.cfg Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.ssl = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.ssl_version = {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_notifications.driver = [] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_notifications.retry = -1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] oslo_messaging_notifications.transport_url = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] key_manager.fixed_key = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.barbican_api_version = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.barbican_endpoint = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.barbican_endpoint_type = public {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.barbican_region_name = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.cafile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.certfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.collect_timing = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.insecure = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.keyfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.number_of_retries = 60 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.retry_delay = 1 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.send_service_user_token = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.split_loggers = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.timeout = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.verify_ssl = True {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican.verify_ssl_path = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican_service_user.auth_section = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican_service_user.auth_type = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican_service_user.cafile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican_service_user.certfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican_service_user.collect_timing = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican_service_user.insecure = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican_service_user.keyfile = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican_service_user.split_loggers = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] barbican_service_user.timeout = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.approle_role_id = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.approle_secret_id = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.auth_method = approle {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.auth_path = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.kv_mountpoint = secret {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.kv_path = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.kv_version = 2 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.namespace = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.root_token_id = **** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.ssl_ca_crt_file = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.timeout = 60.0 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.token_file = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.token_role = None {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.use_ssl = False {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:35 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] ******************************************************************************** {{(pid=93585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 11:57:35 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.433s {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:35 devstack cinder-volume[93802]: INFO cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d succeeded Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=93802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.448s {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:35 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 11:57:35 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:35 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.232s {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:35 devstack cinder-volume[93802]: INFO cinder.volume.driver [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG cinder.volume.driver [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8016510009766, 'free_capacity_gb': 1774.8016510009766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93802) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_db.sqlalchemy.engines [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93802) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG dbcounter [-] [93802] Writer thread running {{(pid=93802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG cinder.db.api [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Building query based on filter {{(pid=93802) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG cinder.image.image_utils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93802) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 11:57:35 devstack cinder-volume[93802]: INFO cinder.keymgr.migration [None req-343750a1-eede-41b0-ac52-a37b1c2da99c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=93802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=93802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:57:35 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:35 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 11:57:35 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:36 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.252s {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG cinder.manager [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Notifying Schedulers of capabilities ... {{(pid=93802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:57:36 devstack cinder-volume[93802]: INFO cinder.volume.manager [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Driver initialization completed successfully. Aug 26 11:57:36 devstack cinder-volume[93802]: INFO cinder.manager [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Initiating service 3 cleanup Aug 26 11:57:36 devstack cinder-volume[93802]: INFO cinder.manager [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Service 3 cleanup completed. Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG cinder.service [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Creating RPC server for service cinder-volume {{(pid=93802) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG cinder.service [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93802) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 11:57:36 devstack cinder-volume[93802]: INFO cinder.volume.manager [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=93802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.quobyte [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=93802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:36 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 11:57:36 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:36 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:36 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.416s {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:36 devstack cinder-volume[93802]: INFO cinder.volume.manager [None req-d1bde4be-6a7d-4e33-bd49-60c9be6e24b7 None None] Driver post RPC initialization completed successfully. Aug 26 11:57:40 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-27aae1e1-6d55-4ad3-9aab-c9bd4197475b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:57:40 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-27aae1e1-6d55-4ad3-9aab-c9bd4197475b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:57:40 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.quobyte [None req-27aae1e1-6d55-4ad3-9aab-c9bd4197475b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=93802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:57:40 devstack cinder-volume[93802]: DEBUG cinder.volume.drivers.quobyte [None req-27aae1e1-6d55-4ad3-9aab-c9bd4197475b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=93802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:57:40 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-27aae1e1-6d55-4ad3-9aab-c9bd4197475b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:57:40 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-27aae1e1-6d55-4ad3-9aab-c9bd4197475b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:40 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 11:57:40 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:40 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:40 devstack cinder-volume[93802]: DEBUG oslo_concurrency.processutils [None req-27aae1e1-6d55-4ad3-9aab-c9bd4197475b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.240s {{(pid=93802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:40 devstack cinder-volume[93802]: DEBUG cinder.manager [None req-27aae1e1-6d55-4ad3-9aab-c9bd4197475b None None] Notifying Schedulers of capabilities ... {{(pid=93802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:57:41 devstack cinder-volume[93585]: INFO oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Caught SIGTERM, stopping children Aug 26 11:57:41 devstack cinder-volume[93585]: DEBUG oslo_concurrency.lockutils [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Acquiring lock "singleton_lock" {{(pid=93585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 11:57:41 devstack cinder-volume[93585]: DEBUG oslo_concurrency.lockutils [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Acquired lock "singleton_lock" {{(pid=93585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 11:57:41 devstack cinder-volume[93585]: DEBUG oslo_concurrency.lockutils [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Releasing lock "singleton_lock" {{(pid=93585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 11:57:41 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Stop services. {{(pid=93585) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 11:57:41 devstack cinder-volume[93585]: DEBUG oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Killing children. {{(pid=93585) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 11:57:41 devstack cinder-volume[93585]: INFO oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Waiting on 1 children to exit Aug 26 11:57:44 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Acquiring lock "singleton_lock" {{(pid=93802) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 11:57:44 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Acquired lock "singleton_lock" {{(pid=93802) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 11:57:44 devstack cinder-volume[93802]: DEBUG oslo_concurrency.lockutils [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Releasing lock "singleton_lock" {{(pid=93802) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 11:57:44 devstack cinder-volume[93802]: WARNING amqp [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 11:57:44 devstack cinder-volume[93802]: WARNING amqp [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 11:57:44 devstack cinder-volume[93585]: INFO oslo_service.backend._eventlet.service [None req-0018511f-d77a-411d-8673-77bbc19b14aa None None] Child 93802 exited with status 0 Aug 26 11:57:45 devstack cinder-volume[94092]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 11:57:45 devstack cinder-volume[94092]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 11:57:45 devstack cinder-volume[94092]: we strongly recommend against using it for new projects. Aug 26 11:57:45 devstack cinder-volume[94092]: If you are already using Eventlet, we recommend migrating to a different Aug 26 11:57:45 devstack cinder-volume[94092]: framework. For more detail see Aug 26 11:57:45 devstack cinder-volume[94092]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 11:57:45 devstack cinder-volume[94092]: import eventlet # noqa Aug 26 11:57:47 devstack cinder-volume[94092]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 11:57:47 devstack cinder-volume[94092]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 11:57:47 devstack cinder-volume[94092]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 11:57:48 devstack cinder-volume[94092]: INFO dbcounter [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Registered counter for database cinder Aug 26 11:57:48 devstack cinder-volume[94092]: DEBUG oslo_db.sqlalchemy.engines [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG dbcounter [-] [94092] Writer thread running {{(pid=94092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 11:57:49 devstack cinder-volume[94092]: INFO cinder.rpc [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 11:57:49 devstack cinder-volume[94092]: INFO cinder.rpc [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_db.sqlalchemy.engines [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:57:49 devstack cinder-volume[94092]: INFO cinder.volume.manager [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Determined volume DB was empty at startup. Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG cinder.volume.manager [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94092) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 11:57:49 devstack cinder-volume[94092]: WARNING stevedore.named [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 11:57:49 devstack cinder-volume[94092]: WARNING castellan.key_manager [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 11:57:49 devstack cinder-volume[94092]: WARNING cinder.keymgr.conf_key_mgr [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 11:57:49 devstack cinder-volume[94092]: INFO cinder.volume.manager [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_db.sqlalchemy.engines [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:57:49 devstack cinder-volume[94092]: INFO oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Starting 1 workers Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Started child 94387 {{(pid=94092) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Full set of CONF: {{(pid=94092) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] ******************************************************************************** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] Configuration options gathered from: {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] ================================================================================ {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] allow_availability_zone_fallback = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94387]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] allow_compression_on_image_upload = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] allowed_direct_url_schemes = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] api_rate_limit = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] auth_strategy = keystone {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_availability_zone = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_host = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_stats_polling_interval = 60 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backup_api_class = cinder.backup.api.API {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backup_name_template = backup-%s {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backup_use_same_host = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backup_use_temp_snapshot = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] chap_password = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] chap_username = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cinder_internal_tenant_project_id = bf2023d296704ad59507ac1a4b33aaf1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cinder_internal_tenant_user_id = 8424e8a9818a4e57aeddaad239bcfc64 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cluster = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] compression_format = gzip {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] compute_api_class = cinder.compute.nova.API {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] config_dir = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] config_source = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] control_exchange = openstack {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] debug = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] default_availability_zone = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] default_group_type = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] default_volume_type = QuobyteHD {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] disk_geometry = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] driver_client_cert = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] driver_client_cert_key = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] driver_data_namespace = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] driver_ssl_cert_path = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] driver_ssl_cert_verify = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] driver_use_ssl = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] enable_new_services = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] enable_unsupported_driver = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] enabled_backends = ['QuobyteHD'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] enforce_multipath_for_image_xfer = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] filter_function = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_api_insecure = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_api_servers = ['http://192.168.122.122/image'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_api_ssl_compression = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_ca_certificates_file = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_catalog_info = image:glance:publicURL {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_certfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_keyfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_num_retries = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance_request_timeout = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] goodness_function = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] graceful_shutdown_timeout = 5 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] group_api_class = cinder.group.api.API {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] host = devstack {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_compress_on_upload = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_conversion_address_space_limit = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_conversion_cpu_limit = 60 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_conversion_disable = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_upload_use_cinder_backend = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_upload_use_internal_tenant = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_volume_cache_enabled = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_volume_cache_max_count = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] image_volume_cache_max_size_gb = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] init_host_max_objects_retrieval = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] instance_format = [instance: %(uuid)s] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] iscsi_target_flags = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] iscsi_write_cache = on {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] iser_helper = tgtadm {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] iser_ip_address = 192.168.122.122 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] iser_port = 3260 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] log_color = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] log_config_append = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] log_dir = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] log_file = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] log_options = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] log_rotate_interval = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] log_rotate_interval_type = days {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] log_rotation_type = none {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] max_age = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] max_logfile_count = 30 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] max_logfile_size_mb = 200 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] max_over_subscription_ratio = 20.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] message_reap_interval = 86400 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] message_ttl = 2592000 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] migration_create_volume_timeout_secs = 300 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] monkey_patch = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] monkey_patch_modules = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] my_ip = 192.168.122.122 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] no_snapshot_gb_quota = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] num_iser_scan_tries = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] num_shell_tries = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] num_volume_device_scan_tries = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] nvmeof_conn_info_version = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] nvmet_ns_id = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] nvmet_port_id = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] osapi_max_limit = 1000 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] osapi_volume_ext_list = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] osapi_volume_listen_port = 8776 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] osapi_volume_use_ssl = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] osapi_volume_workers = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] per_volume_size_limit = -1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] periodic_fuzzy_delay = 60 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] periodic_interval = 60 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94387) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] public_endpoint = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] publish_errors = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] quota_backup_gigabytes = 1000 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] quota_backups = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] quota_gigabytes = 1000 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] quota_groups = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] quota_snapshots = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] quota_volumes = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] rate_limit_burst = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] rate_limit_except_level = CRITICAL {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] rate_limit_interval = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] reinit_driver_count = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] replication_device = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] report_discard_supported = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] report_interval = 120 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] reservation_clean_interval = 86400 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] reservation_expire = 86400 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] reserved_image_namespaces = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] reserved_percentage = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] rpc_response_timeout = 120 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] run_external_periodic_tasks = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] scst_target_driver = iscsi {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] scst_target_iqn_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_down_time = 720 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] shell_completion = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] snapshot_name_template = snapshot-%s {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] split_loggers = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] state_path = /opt/stack/data/cinder {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] storage_availability_zone = nova {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] storage_protocol = iSCSI {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] syslog_log_facility = LOG_USER {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] target_helper = lioadm {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] target_ip_address = 192.168.122.122 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] target_port = 3260 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] target_protocol = iscsi {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] target_secondary_ip_addresses = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] trace_flags = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] transport_url = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] until_refresh = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] use_chap_auth = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] use_default_quota_class = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] use_journal = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] use_json = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] use_multipath_for_image_xfer = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] use_stderr = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] use_syslog = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] verify_glance_signatures = enabled {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_api_class = cinder.volume.api.API {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_backend_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_clear = zero {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_clear_ionice = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_clear_size = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_copy_bps_limit = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_dd_blocksize = 1M {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_name_template = volume-%s {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_service_inithost_offload = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volume_usage_audit_period = month {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] zoning_mode = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_concurrency.disable_process_locking = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.auth_section = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.auth_type = password {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.auth_version = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.cache = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.certfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.include_service_catalog = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.insecure = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.interface = public {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.keyfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_password = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcache_username = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.region_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.service_type = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.122/identity {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.backend = dogpile.cache.null {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.backend_argument = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.backend_expiration_time = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.config_prefix = cache.oslo {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.debug_cache_backend = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.enable_retry_client = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.enable_socket_keepalive = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.enabled = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.expiration_time = 600 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.hashclient_retry_attempts = 2 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.memcache_dead_retry = 300 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.memcache_pool_maxsize = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.memcache_sasl_enabled = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.password = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.proxies = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.redis_db = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.redis_server = localhost:6379 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.retry_attempts = 2 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.retry_delay = 0.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.socket_keepalive_count = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.socket_keepalive_idle = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.socket_keepalive_interval = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.socket_timeout = 1.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.tls_allowed_ciphers = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.tls_cafile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.tls_certfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.tls_enabled = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.tls_keyfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cache.username = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] coordination.backend_url = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.asyncio_connection = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.asyncio_slave_connection = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.backend = sqlalchemy {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.connection = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.connection_debug = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.connection_parameters = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.connection_recycle_time = 3600 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.connection_trace = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.db_inc_retry_interval = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.db_max_retries = 20 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.db_max_retry_interval = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.db_retry_interval = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.max_overflow = 50 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.max_pool_size = 5 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.max_retries = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.mysql_wsrep_sync_wait = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.pool_timeout = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.retry_interval = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.slave_connection = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.sqlite_synchronous = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.synchronous_reader = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] database.use_db_reconnect = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.connection_string = messaging:// {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.enabled = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.es_doc_type = notification {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.es_scroll_size = 10000 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.es_scroll_time = 2m {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.filter_error_trace = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.hmac_keys = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94387) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.sentinel_service_name = mymaster {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.socket_timeout = 0.1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.trace_requests = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler.trace_sqlalchemy = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler_jaeger.process_tags = {} {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.quobyte [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler_jaeger.service_name_prefix = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.quobyte [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] profiler_otlp.service_name_prefix = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.enforce_new_defaults = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.policy_default_rule = default {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.policy_file = policy.yaml {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Running cmd (subprocess): mount.quobyte {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] privsep_osbrick.group = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] privsep_osbrick.helper_command = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] privsep_osbrick.user = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cinder_sys_admin.group = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cinder_sys_admin.helper_command = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] cinder_sys_admin.user = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.auth_section = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.auth_type = password {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.cafile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.certfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.collect_timing = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.insecure = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.keyfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.send_service_user_token = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.split_loggers = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] service_user.timeout = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.auth_section = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.auth_type = password {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.certfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.collect_timing = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.insecure = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.keyfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.region_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.split_loggers = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] glance.timeout = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.backend_availability_zone = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.chap_password = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.chap_username = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.disk_geometry = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.driver_client_cert = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.driver_client_cert_key = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.driver_data_namespace = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.driver_use_ssl = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.extra_capabilities = {} {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.filter_function = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.goodness_function = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.iscsi_target_flags = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.iscsi_write_cache = on {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.iser_helper = tgtadm {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.iser_ip_address = 192.168.122.122 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.iser_port = 3260 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_host = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_login = admin {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_mount_options = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_password = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_private_key = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_share_path = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.num_shell_tries = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.quobyte_volume_url = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.replication_device = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.report_discard_supported = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.reserved_percentage = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.target_helper = tgtadm {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.target_ip_address = 192.168.122.122 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack quobyte-client[94388]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.target_port = 3260 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.target_protocol = iscsi {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.trace_flags = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.unique_fqdn_network = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack quobyte-client[94388]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.use_chap_auth = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.volume_backend_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.volume_clear = zero {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.volume_clear_ionice = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.volume_clear_size = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_reports.file_event_handler = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_reports.log_dir = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.backend_availability_zone = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.backend_host = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.chap_password = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.chap_username = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.chiscsi_conf = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.disk_geometry = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.driver_client_cert = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.driver_data_namespace = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.driver_use_ssl = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.extra_capabilities = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.filter_function = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.goodness_function = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.iser_helper = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.iser_ip_address = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.iser_port = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.iser_target_prefix = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_host = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_login = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_mount_options = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_password = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_private_key = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_share_path = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_ssh_port = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.num_shell_tries = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.nvmet_port_id = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.replication_device = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.report_discard_supported = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.reserved_percentage = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.scst_target_driver = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.storage_protocol = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.target_helper = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.target_ip_address = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.target_port = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.target_prefix = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.target_protocol = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.trace_flags = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.use_chap_auth = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.volume_clear = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.volume_clear_size = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] QuobyteHD.volumes_dir = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.ssl = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_notifications.driver = [] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_notifications.retry = -1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] key_manager.fixed_key = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.barbican_api_version = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.barbican_endpoint = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.barbican_endpoint_type = public {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.barbican_region_name = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.cafile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.certfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.collect_timing = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.insecure = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.keyfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.number_of_retries = 60 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.retry_delay = 1 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.send_service_user_token = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.split_loggers = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.timeout = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.verify_ssl = True {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican.verify_ssl_path = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican_service_user.auth_section = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican_service_user.auth_type = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican_service_user.cafile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican_service_user.certfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican_service_user.collect_timing = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican_service_user.insecure = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican_service_user.keyfile = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican_service_user.split_loggers = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] barbican_service_user.timeout = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.approle_role_id = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.approle_secret_id = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.auth_method = approle {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.auth_path = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.kv_mountpoint = secret {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.kv_path = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.kv_version = 2 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.namespace = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.root_token_id = **** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.ssl_ca_crt_file = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.timeout = 60.0 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.token_file = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.token_role = None {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.use_ssl = False {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 11:57:49 devstack cinder-volume[94092]: DEBUG oslo_service.backend._eventlet.service [None req-fee97cd3-2d76-48eb-9c60-a247ece617d1 None None] ******************************************************************************** {{(pid=94092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 11:57:49 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.248s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:49 devstack cinder-volume[94387]: INFO cinder.volume.driver [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Driver hasn't implemented _init_vendor_properties() Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG cinder.volume.driver [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8016510009766, 'free_capacity_gb': 1774.8016510009766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94387) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_db.sqlalchemy.engines [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writer thread running {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG cinder.db.api [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Building query based on filter {{(pid=94387) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94387) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:57:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:49 devstack cinder-volume[94387]: INFO cinder.keymgr.migration [None req-77e1a9e5-9058-4724-91fd-bc7cada697ac None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 11:57:49 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 11:57:49 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:50 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.228s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:57:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Driver initialization completed successfully. Aug 26 11:57:50 devstack cinder-volume[94387]: INFO cinder.manager [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Initiating service 3 cleanup Aug 26 11:57:50 devstack cinder-volume[94387]: INFO cinder.manager [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Service 3 cleanup completed. Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG cinder.service [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Creating RPC server for service cinder-volume {{(pid=94387) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG cinder.service [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94387) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 11:57:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:57:50 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 11:57:50 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:57:50 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Aug 26 11:57:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.232s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:57:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-312669c7-dfa9-4bbc-9e67-d5ca7781f77e None None] Driver post RPC initialization completed successfully. Aug 26 11:57:59 devstack cinder-volume[94092]: DEBUG dbcounter [-] [94092] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:57:59 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:58:00 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=4 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:58:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:58:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 6 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 11:58:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Flow 'volume_create_manager' (4b8bdf92-0d95-4160-aafc-c4ddfeb9578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30c3abc-664b-40cf-9f01-fc6d4f1621ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30c3abc-664b-40cf-9f01-fc6d4f1621ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T09:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-399739775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9943366-8549-4dc9-a003-8c574d04b5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc058190b8a4c3d9c42e1b90f9fc067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T09:58:49Z,use_quota=True,user_id='2384d43576d74066ad76061c7194ddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638b2fa3-fe9a-4e6b-a053-5be4a5a8f426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638b2fa3-fe9a-4e6b-a053-5be4a5a8f426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9aa4f0-43b1-493f-ba52-f908634d60f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9aa4f0-43b1-493f-ba52-f908634d60f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9943366-8549-4dc9-a003-8c574d04b5ce', 'volume_name': 'volume-e9943366-8549-4dc9-a003-8c574d04b5ce', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bd965e-553f-403d-9cb9-5d662217fcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bd965e-553f-403d-9cb9-5d662217fcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9113a5-2713-470c-aa51-d2a5548ee979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:58:49 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Volume e9943366-8549-4dc9-a003-8c574d04b5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9943366-8549-4dc9-a003-8c574d04b5ce', 'volume_size': 1} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T09:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-399739775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9943366-8549-4dc9-a003-8c574d04b5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc058190b8a4c3d9c42e1b90f9fc067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T09:58:49Z,use_quota=True,user_id='2384d43576d74066ad76061c7194ddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Creating volume e9943366-8549-4dc9-a003-8c574d04b5ce {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 11:58:49 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 11:58:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:58:49 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce 1073741824 Aug 26 11:58:49 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:58:50 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Aug 26 11:58:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce 1073741824" returned: 0 in 0.714s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:58:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:58:50 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce Aug 26 11:58:50 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:58:50 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Aug 26 11:58:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce" returned: 0 in 0.453s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:58:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 11:58:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:58:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9113a5-2713-470c-aa51-d2a5548ee979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9943366-8549-4dc9-a003-8c574d04b5ce', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:58:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71289a7-c542-488d-b7c5-55eb32ac57b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:58:50 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Volume volume-e9943366-8549-4dc9-a003-8c574d04b5ce (e9943366-8549-4dc9-a003-8c574d04b5ce): created successfully Aug 26 11:58:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71289a7-c542-488d-b7c5-55eb32ac57b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:58:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Flow 'volume_create_manager' (4b8bdf92-0d95-4160-aafc-c4ddfeb9578c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 11:58:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e977f338-c42c-4bba-a47b-dcfe20070c1e tempest-TaggedAttachmentsTest-1529897816 None] Created volume successfully. Aug 26 11:59:00 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:59:00 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:59:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:59:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:59:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:59:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:59:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:59:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:59:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:59:10 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 11:59:10 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:59:11 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Aug 26 11:59:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.453s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:59:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:59:11 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 11:59:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 6 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 11:59:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Flow 'volume_create_manager' (47c9bab2-0d3a-4e92-8823-f4a6d32def69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01d258f-d4cd-445d-bf50-ea86a08b9d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01d258f-d4cd-445d-bf50-ea86a08b9d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1276033673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce78362e1cd4281acb70e091d4c9fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T09:59:21Z,use_quota=True,user_id='1b109e7cf1674330b8f49e0598fa4112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61108235-05f4-4059-8aab-91105ca1481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61108235-05f4-4059-8aab-91105ca1481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4be125-be49-4fcc-96fa-22d9ba72e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4be125-be49-4fcc-96fa-22d9ba72e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a', 'volume_name': 'volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f482edae-fdda-4d5c-9394-a394be838596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f482edae-fdda-4d5c-9394-a394be838596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d3e96f-0e84-448a-9a5a-dd0365e053b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:21 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Volume 8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a', 'volume_size': 1} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1276033673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce78362e1cd4281acb70e091d4c9fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T09:59:21Z,use_quota=True,user_id='1b109e7cf1674330b8f49e0598fa4112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Creating volume 8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 11:59:21 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 11:59:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:59:21 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a 1073741824 Aug 26 11:59:21 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:59:22 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Aug 26 11:59:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a 1073741824" returned: 0 in 0.715s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:59:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:59:22 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a Aug 26 11:59:22 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:59:22 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Aug 26 11:59:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a" returned: 0 in 0.429s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:59:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 11:59:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:59:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d3e96f-0e84-448a-9a5a-dd0365e053b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79245144-2db2-43f6-a3d7-f5f4bdc8f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:22 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Volume volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a (8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a): created successfully Aug 26 11:59:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79245144-2db2-43f6-a3d7-f5f4bdc8f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Flow 'volume_create_manager' (47c9bab2-0d3a-4e92-8823-f4a6d32def69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 11:59:22 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-32a18448-90b6-4c3b-b7fd-5046274ccc99 tempest-VolumesAdminNegativeTest-1772776602 None] Created volume successfully. Aug 26 11:59:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Acquiring lock "cinder-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 11:59:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "cinder-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 11:59:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Acquiring lock "cinder-quobyte-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 11:59:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "cinder-quobyte-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 11:59:24 devstack cinder-volume[94387]: INFO oslo.privsep.daemon [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbkwbw9_l/privsep.sock'] Aug 26 11:59:24 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbkwbw9_l/privsep.sock Aug 26 11:59:24 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:59:25 devstack cinder-volume[94387]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 26 11:59:25 devstack cinder-volume[94387]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 11:59:25 devstack cinder-volume[94387]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 26 11:59:25 devstack cinder-volume[94387]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 11:59:25 devstack cinder-volume[94387]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 26 11:59:25 devstack cinder-volume[94387]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 26 11:59:25 devstack cinder-volume[94387]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 11:59:25 devstack cinder-volume[94387]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 11:59:25 devstack cinder-volume[94387]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 26 11:59:25 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Aug 26 11:59:25 devstack cinder-volume[94387]: INFO oslo.privsep.daemon [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Spawned new privsep daemon via rootwrap Aug 26 11:59:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Accepted privsep connection to /tmp/tmpbkwbw9_l/privsep.sock {{(pid=94387) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 26 11:59:25 devstack cinder-volume[94387]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 26 11:59:25 devstack cinder-volume[94387]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 26 11:59:25 devstack cinder-volume[94387]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 26 11:59:25 devstack cinder-volume[94387]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95605 Aug 26 11:59:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54d9aad-80ef-4063-8799-16478f959dc3]: (2,) {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 11:59:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1862dfa0-a62e-4208-be48-e102df808e6d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 11:59:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:59:26 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a Aug 26 11:59:26 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:59:26 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Aug 26 11:59:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a" returned: 0 in 0.879s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:59:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:59:26 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a Aug 26 11:59:26 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:59:27 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Aug 26 11:59:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a" returned: 0 in 0.466s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:59:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "cinder-quobyte-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a" released by "delete_volume" :: held 3.031s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 11:59:27 devstack cinder-volume[94387]: WARNING cinder.quota [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 11:59:27 devstack cinder-volume[94387]: WARNING cinder.quota [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 11:59:27 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Created reservations ['8353e105-e2e2-4329-844f-db56420a17e3', '94f266f3-57dc-44ea-9a64-d915992e0083', 'd6902b90-d611-4c7e-b4be-ed9da86846b0', 'a9c1c32d-47a1-4edb-8b14-4ac73dc7410a'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 11:59:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:59:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:59:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:59:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:59:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:59:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:59:27 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 11:59:27 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:59:28 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Aug 26 11:59:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.648s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:59:28 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 11:59:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Deleted volume successfully. Aug 26 11:59:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ea078910-56a1-4a86-8f0d-e0d52e8085f5 tempest-VolumesAdminNegativeTest-1772776602 None] Lock "cinder-8b7eb4db-dd41-47c4-a3a7-c3aae0cfab2a-delete_volume" released by "delete_volume" :: held 4.220s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 11:59:37 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:DELETE=1,cinder:INSERT=2 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:59:38 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Flow 'volume_create_manager' (d3993cfa-4dc7-4833-8836-6fc4f1c47473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74d360e-b2ba-4491-9131-1e932b146429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74d360e-b2ba-4491-9131-1e932b146429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T09:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1695129980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9991dc40-96d7-4a72-bc97-49856e085766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487fcb35425543c69015c010587b94dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T09:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T09:59:41Z,use_quota=True,user_id='5dec49a8c8fd461aa9dbf31951106abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1f117d-9f2a-446b-a388-6feb21e356f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1f117d-9f2a-446b-a388-6feb21e356f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147631d2-3bc1-41ee-9808-1079e79f290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147631d2-3bc1-41ee-9808-1079e79f290f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9991dc40-96d7-4a72-bc97-49856e085766', 'volume_name': 'volume-9991dc40-96d7-4a72-bc97-49856e085766', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4f64cf-078d-4491-a97f-fa50f22d4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4f64cf-078d-4491-a97f-fa50f22d4369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e146b14-d332-4f91-8e4e-b28fb6a53abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:40 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Volume 9991dc40-96d7-4a72-bc97-49856e085766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9991dc40-96d7-4a72-bc97-49856e085766', 'volume_size': 1} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T09:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1695129980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9991dc40-96d7-4a72-bc97-49856e085766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487fcb35425543c69015c010587b94dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T09:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T09:59:41Z,use_quota=True,user_id='5dec49a8c8fd461aa9dbf31951106abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Creating volume 9991dc40-96d7-4a72-bc97-49856e085766 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 11:59:40 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 11:59:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:59:41 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766 1073741824 Aug 26 11:59:41 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:59:41 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Aug 26 11:59:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766 1073741824" returned: 0 in 0.670s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:59:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 11:59:41 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766 Aug 26 11:59:41 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 11:59:42 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Aug 26 11:59:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766" returned: 0 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 11:59:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 11:59:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:59:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e146b14-d332-4f91-8e4e-b28fb6a53abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9991dc40-96d7-4a72-bc97-49856e085766', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565646c1-2546-4d2e-9d97-dd65e79c6884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 11:59:42 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Volume volume-9991dc40-96d7-4a72-bc97-49856e085766 (9991dc40-96d7-4a72-bc97-49856e085766): created successfully Aug 26 11:59:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565646c1-2546-4d2e-9d97-dd65e79c6884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 11:59:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Flow 'volume_create_manager' (d3993cfa-4dc7-4833-8836-6fc4f1c47473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 11:59:42 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-9aa31b4e-89e0-4430-8dd6-2f1202628a15 tempest-AttachVolumeNegativeTest-1938816741 None] Created volume successfully. Aug 26 11:59:47 devstack cinder-volume[94387]: WARNING py.warnings [req-39dd57c5-5102-4f32-ba5b-a4cb37fce486 req-4b46ca33-b31e-492a-a096-c1c41a3bad3b tempest-AttachVolumeNegativeTest-1938816741 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Aug 26 11:59:47 devstack cinder-volume[94387]: .first() Aug 26 11:59:47 devstack cinder-volume[94387]: Aug 26 11:59:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-39dd57c5-5102-4f32-ba5b-a4cb37fce486 req-4b46ca33-b31e-492a-a096-c1c41a3bad3b tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 11:59:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-39dd57c5-5102-4f32-ba5b-a4cb37fce486 req-4b46ca33-b31e-492a-a096-c1c41a3bad3b tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 11:59:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-39dd57c5-5102-4f32-ba5b-a4cb37fce486 req-4b46ca33-b31e-492a-a096-c1c41a3bad3b tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 11:59:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-39dd57c5-5102-4f32-ba5b-a4cb37fce486 req-4b46ca33-b31e-492a-a096-c1c41a3bad3b tempest-AttachVolumeNegativeTest-1938816741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-9991dc40-96d7-4a72-bc97-49856e085766', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8a4eaad-e25f-42a5-80dd-b7d02a983e75', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 11:59:47 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-39dd57c5-5102-4f32-ba5b-a4cb37fce486 req-4b46ca33-b31e-492a-a096-c1c41a3bad3b tempest-AttachVolumeNegativeTest-1938816741 None] attachment_update completed successfully. Aug 26 11:59:57 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:00:00 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:00:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-8e08b195-07dd-46e6-bb2f-4aeaf27d549b req-718b1579-47ba-4170-9608-45d2fe0223ea tempest-TaggedAttachmentsTest-1529897816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:00:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-8e08b195-07dd-46e6-bb2f-4aeaf27d549b req-718b1579-47ba-4170-9608-45d2fe0223ea tempest-TaggedAttachmentsTest-1529897816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:00:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-8e08b195-07dd-46e6-bb2f-4aeaf27d549b req-718b1579-47ba-4170-9608-45d2fe0223ea tempest-TaggedAttachmentsTest-1529897816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:00:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-8e08b195-07dd-46e6-bb2f-4aeaf27d549b req-718b1579-47ba-4170-9608-45d2fe0223ea tempest-TaggedAttachmentsTest-1529897816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-e9943366-8549-4dc9-a003-8c574d04b5ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39d50030-e0a2-452f-88ad-70f8a8493c42', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:00:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-8e08b195-07dd-46e6-bb2f-4aeaf27d549b req-718b1579-47ba-4170-9608-45d2fe0223ea tempest-TaggedAttachmentsTest-1529897816 None] attachment_update completed successfully. Aug 26 12:00:07 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-836a500f-0f5b-4ade-86f5-54d019ff2ed4 req-51ccc708-58aa-425c-a4a7-7f08aea786f2 tempest-TaggedAttachmentsTest-1529897816 None] Terminate volume connection completed successfully. Aug 26 12:00:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-836a500f-0f5b-4ade-86f5-54d019ff2ed4 req-51ccc708-58aa-425c-a4a7-7f08aea786f2 tempest-TaggedAttachmentsTest-1529897816 None] Deleting attachment 39d50030-e0a2-452f-88ad-70f8a8493c42. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Flow 'volume_create_manager' (166d86bc-ff47-40c6-b59f-f587bf283554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2536c301-aa87-4e56-9665-88b405acf052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2536c301-aa87-4e56-9665-88b405acf052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-78122216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a4652c-1746-4b7f-9627-86616a4064b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c269344e608c426abd3b1b7ec0496623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:00:08Z,use_quota=True,user_id='1d4ce686ca8646bf98b7a565b87be437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6e8367-7c80-4a2a-b763-2b3bc8e535b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6e8367-7c80-4a2a-b763-2b3bc8e535b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f47fc6c-5ca8-4d36-a98d-710abce59476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f47fc6c-5ca8-4d36-a98d-710abce59476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a4652c-1746-4b7f-9627-86616a4064b8', 'volume_name': 'volume-90a4652c-1746-4b7f-9627-86616a4064b8', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3023624c-cad8-4002-899f-25f89edaf084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3023624c-cad8-4002-899f-25f89edaf084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4edc161-dd9e-494e-a5a8-b699e08e8440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:08 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Volume 90a4652c-1746-4b7f-9627-86616a4064b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a4652c-1746-4b7f-9627-86616a4064b8', 'volume_size': 1} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-78122216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a4652c-1746-4b7f-9627-86616a4064b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c269344e608c426abd3b1b7ec0496623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:00:08Z,use_quota=True,user_id='1d4ce686ca8646bf98b7a565b87be437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Creating volume 90a4652c-1746-4b7f-9627-86616a4064b8 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:00:08 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:00:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:08 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8 1073741824 Aug 26 12:00:08 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:09 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8 1073741824" returned: 0 in 1.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:09 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8 Aug 26 12:00:09 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:10 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8" returned: 0 in 0.716s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:00:10 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:00:10 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4edc161-dd9e-494e-a5a8-b699e08e8440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a4652c-1746-4b7f-9627-86616a4064b8', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca2ae47-6763-492c-bb75-91ed5b76155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:10 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Volume volume-90a4652c-1746-4b7f-9627-86616a4064b8 (90a4652c-1746-4b7f-9627-86616a4064b8): created successfully Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca2ae47-6763-492c-bb75-91ed5b76155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Flow 'volume_create_manager' (166d86bc-ff47-40c6-b59f-f587bf283554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:00:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-9a2de4be-6b3f-4358-b965-69c81b59f522 tempest-ServerRescueNegativeTestJSON-1253324189 None] Created volume successfully. Aug 26 12:00:11 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.814s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:00:20 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:00:20 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:00:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Acquiring lock "cinder-e9943366-8549-4dc9-a003-8c574d04b5ce-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:00:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Lock "cinder-e9943366-8549-4dc9-a003-8c574d04b5ce-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:00:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Acquiring lock "cinder-quobyte-e9943366-8549-4dc9-a003-8c574d04b5ce" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:00:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Lock "cinder-quobyte-e9943366-8549-4dc9-a003-8c574d04b5ce" acquired by "delete_volume" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:00:27 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c194125-b874-4561-847d-0ba22e983368]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:00:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:27 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce Aug 26 12:00:27 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:27 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce" returned: 0 in 0.423s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:27 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce Aug 26 12:00:27 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:28 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e9943366-8549-4dc9-a003-8c574d04b5ce" returned: 0 in 0.461s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Lock "cinder-quobyte-e9943366-8549-4dc9-a003-8c574d04b5ce" released by "delete_volume" :: held 0.993s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Created reservations ['76982914-da12-4f8d-ae5d-7956d66b51da', '8b283408-c8a4-407d-97ae-18a7137e3ceb', '593f395a-5bb7-45e0-8735-e94e28f8f6cb', 'f6434e33-c193-4376-90c3-f43a1d5503c2'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:28 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:00:28 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:28 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.411s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:00:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Deleted volume successfully. Aug 26 12:00:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2790a1b-0ef2-473a-839d-892c5022ebc4 tempest-TaggedAttachmentsTest-1529897816 None] Lock "cinder-e9943366-8549-4dc9-a003-8c574d04b5ce-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:00:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Acquiring lock "cinder-90a4652c-1746-4b7f-9627-86616a4064b8-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:00:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "cinder-90a4652c-1746-4b7f-9627-86616a4064b8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:00:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Acquiring lock "cinder-quobyte-90a4652c-1746-4b7f-9627-86616a4064b8" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:00:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "cinder-quobyte-90a4652c-1746-4b7f-9627-86616a4064b8" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:00:32 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b530af-db3f-4270-baa5-421a8703e5e8]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:00:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:32 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8 Aug 26 12:00:32 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:33 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8" returned: 0 in 0.651s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:33 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8 Aug 26 12:00:33 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:33 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-90a4652c-1746-4b7f-9627-86616a4064b8" returned: 0 in 0.315s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "cinder-quobyte-90a4652c-1746-4b7f-9627-86616a4064b8" released by "delete_volume" :: held 1.040s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Created reservations ['3511de18-89e2-4103-af52-495a3dc6895a', '03a3edab-b417-480e-8ce2-5952b00d002a', '790f4c21-a2ef-42d2-aa0a-e8b39a3782ff', '416d2a3a-059f-4158-aa8c-8e4eab3bd196'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:00:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:33 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:00:33 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:34 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.504s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:34 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:00:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Deleted volume successfully. Aug 26 12:00:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-827239b4-96bc-4e67-9d2e-453d2e77b4b8 tempest-ServerRescueNegativeTestJSON-1253324189 None] Lock "cinder-90a4652c-1746-4b7f-9627-86616a4064b8-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:00:43 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=10,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:00:44 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:00:47 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:00:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Flow 'volume_create_manager' (efe27d9a-561b-45d7-bc03-3c5cb91127c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:00:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202756e9-a07b-4c72-85d0-3e9d945ee8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202756e9-a07b-4c72-85d0-3e9d945ee8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-199340408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45019a34-a923-402f-bb49-88fdbd888772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bc0de7e39d411e84b6df94dc79b6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:00:48Z,use_quota=True,user_id='0be98856cd6e4a5aa78d3b7c398a41ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1367d6a-f152-4606-91b7-e2c67ce993e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1367d6a-f152-4606-91b7-e2c67ce993e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5398477-b195-40b6-a6fa-edf3d1c7f988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5398477-b195-40b6-a6fa-edf3d1c7f988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45019a34-a923-402f-bb49-88fdbd888772', 'volume_name': 'volume-45019a34-a923-402f-bb49-88fdbd888772', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75946f88-186d-429c-aca2-a293c2d31152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75946f88-186d-429c-aca2-a293c2d31152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea1447a-ec06-4513-9087-d594b32f74a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:48 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Volume 45019a34-a923-402f-bb49-88fdbd888772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45019a34-a923-402f-bb49-88fdbd888772', 'volume_size': 1} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-199340408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45019a34-a923-402f-bb49-88fdbd888772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bc0de7e39d411e84b6df94dc79b6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:00:48Z,use_quota=True,user_id='0be98856cd6e4a5aa78d3b7c398a41ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Creating volume 45019a34-a923-402f-bb49-88fdbd888772 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:00:48 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:48 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772 1073741824 Aug 26 12:00:48 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:48 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772 1073741824" returned: 0 in 0.556s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:48 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772 Aug 26 12:00:48 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-f5acc085-2012-4089-b7f8-34cdf85ced6f req-e89e28e3-33cc-4a35-b45d-db0bcfd556a0 tempest-AttachVolumeNegativeTest-1938816741 None] Terminate volume connection completed successfully. Aug 26 12:00:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-f5acc085-2012-4089-b7f8-34cdf85ced6f req-e89e28e3-33cc-4a35-b45d-db0bcfd556a0 tempest-AttachVolumeNegativeTest-1938816741 None] Deleting attachment c8a4eaad-e25f-42a5-80dd-b7d02a983e75. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:00:49 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772" returned: 0 in 0.623s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:00:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:00:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea1447a-ec06-4513-9087-d594b32f74a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45019a34-a923-402f-bb49-88fdbd888772', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95880f31-fa4e-42bf-86f4-c15ed8b23c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:00:49 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Volume volume-45019a34-a923-402f-bb49-88fdbd888772 (45019a34-a923-402f-bb49-88fdbd888772): created successfully Aug 26 12:00:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95880f31-fa4e-42bf-86f4-c15ed8b23c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:00:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Flow 'volume_create_manager' (efe27d9a-561b-45d7-bc03-3c5cb91127c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:00:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-64f14933-4f97-4c5b-b3fe-c26d43e19f20 tempest-DeleteServersTestJSON-1889328391 None] Created volume successfully. Aug 26 12:00:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-53f6c9f2-193b-46eb-9aea-eafe114444ba req-5ecc6e85-aaeb-4d47-908b-92db7f8f4095 tempest-DeleteServersTestJSON-1889328391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:00:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-53f6c9f2-193b-46eb-9aea-eafe114444ba req-5ecc6e85-aaeb-4d47-908b-92db7f8f4095 tempest-DeleteServersTestJSON-1889328391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:00:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-53f6c9f2-193b-46eb-9aea-eafe114444ba req-5ecc6e85-aaeb-4d47-908b-92db7f8f4095 tempest-DeleteServersTestJSON-1889328391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:00:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-53f6c9f2-193b-46eb-9aea-eafe114444ba req-5ecc6e85-aaeb-4d47-908b-92db7f8f4095 tempest-DeleteServersTestJSON-1889328391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-45019a34-a923-402f-bb49-88fdbd888772', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de88409f-785c-47d7-9b0a-b78bfd2a383b', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:00:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-53f6c9f2-193b-46eb-9aea-eafe114444ba req-5ecc6e85-aaeb-4d47-908b-92db7f8f4095 tempest-DeleteServersTestJSON-1889328391 None] attachment_update completed successfully. Aug 26 12:00:57 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-118b70e7-5117-404e-ac0a-f25d0ffe437e req-92f73cd1-e34d-4903-886e-6d36ed6b0fac tempest-DeleteServersTestJSON-1889328391 None] Terminate volume connection completed successfully. Aug 26 12:00:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-118b70e7-5117-404e-ac0a-f25d0ffe437e req-92f73cd1-e34d-4903-886e-6d36ed6b0fac tempest-DeleteServersTestJSON-1889328391 None] Deleting attachment de88409f-785c-47d7-9b0a-b78bfd2a383b. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:00:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Acquiring lock "cinder-45019a34-a923-402f-bb49-88fdbd888772-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:00:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Lock "cinder-45019a34-a923-402f-bb49-88fdbd888772-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:00:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Acquiring lock "cinder-quobyte-45019a34-a923-402f-bb49-88fdbd888772" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:00:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Lock "cinder-quobyte-45019a34-a923-402f-bb49-88fdbd888772" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:00:59 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[885928d9-d7a0-4c7e-90c2-6bec5aecb889]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:00:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:59 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772 Aug 26 12:00:59 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:00:59 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Aug 26 12:00:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772" returned: 0 in 0.463s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:00:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:00:59 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772 Aug 26 12:00:59 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:01:00 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-45019a34-a923-402f-bb49-88fdbd888772" returned: 0 in 0.295s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Lock "cinder-quobyte-45019a34-a923-402f-bb49-88fdbd888772" released by "delete_volume" :: held 0.808s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Created reservations ['780c286c-730a-404a-9a88-f208aeeba0c2', '10eec988-595e-4676-922c-5788ee99403e', 'e58cc814-5e6d-43a5-b9fd-34bab10656f7', '42469900-0863-484c-9397-e7380319ea25'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:01:00 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:01:00 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:01:00 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.363s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:01:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Deleted volume successfully. Aug 26 12:01:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-013ecad4-20c0-48fd-9004-b1f55460a43c tempest-DeleteServersTestJSON-1889328391 None] Lock "cinder-45019a34-a923-402f-bb49-88fdbd888772-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:01:10 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:01:10 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=12,cinder:SELECT=17,cinder:INSERT=3,cinder:DELETE=2 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:01:10 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.296s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 8 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:01:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:01:53 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Flow 'volume_create_manager' (674ec2e9-c138-45e7-962d-c8ff76f07594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30391dc-1a92-4734-b37a-4b39d21947c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30391dc-1a92-4734-b37a-4b39d21947c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-595938884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44298ce-b728-491a-b119-7a9b4ac7f937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487fcb35425543c69015c010587b94dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:01:54Z,use_quota=True,user_id='5dec49a8c8fd461aa9dbf31951106abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3254ce-395a-4547-968f-d41064b2596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3254ce-395a-4547-968f-d41064b2596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c5aec8-3c84-42e9-9946-4cfefd7edcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c5aec8-3c84-42e9-9946-4cfefd7edcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44298ce-b728-491a-b119-7a9b4ac7f937', 'volume_name': 'volume-c44298ce-b728-491a-b119-7a9b4ac7f937', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3454062-48a0-4a08-803b-70f8938c2a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3454062-48a0-4a08-803b-70f8938c2a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9f8ebb-98ac-43a1-84d8-c971c3ac357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:54 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Volume c44298ce-b728-491a-b119-7a9b4ac7f937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44298ce-b728-491a-b119-7a9b4ac7f937', 'volume_size': 1} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-595938884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44298ce-b728-491a-b119-7a9b4ac7f937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487fcb35425543c69015c010587b94dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:01:54Z,use_quota=True,user_id='5dec49a8c8fd461aa9dbf31951106abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Creating volume c44298ce-b728-491a-b119-7a9b4ac7f937 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:01:54 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:01:54 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937 1073741824 Aug 26 12:01:54 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:01:54 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937 1073741824" returned: 0 in 0.476s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:01:54 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937 Aug 26 12:01:54 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:01:54 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937" returned: 0 in 0.376s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:01:54 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9f8ebb-98ac-43a1-84d8-c971c3ac357b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44298ce-b728-491a-b119-7a9b4ac7f937', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfa4c07-5fc9-4eb6-befb-e083f1c3e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:55 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Volume volume-c44298ce-b728-491a-b119-7a9b4ac7f937 (c44298ce-b728-491a-b119-7a9b4ac7f937): created successfully Aug 26 12:01:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfa4c07-5fc9-4eb6-befb-e083f1c3e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Flow 'volume_create_manager' (674ec2e9-c138-45e7-962d-c8ff76f07594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:01:55 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e3a9e3e2-b169-44ba-9ba6-f06550cf5da4 tempest-AttachVolumeNegativeTest-1938816741 None] Created volume successfully. Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Flow 'volume_create_manager' (afb24e74-bd30-45dc-9689-0a68f38360ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e926848a-b7fc-40b2-ab64-2cbe3e381407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e926848a-b7fc-40b2-ab64-2cbe3e381407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1724083641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d79039-794a-409f-9bc7-a9cc22e11a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809437403f2f4d92be3ad266d1bbb394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:01:57Z,use_quota=True,user_id='ff7bd0f74c7f405f87045f501d785ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dd5580-cf67-42eb-b95b-4c96fc71fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dd5580-cf67-42eb-b95b-4c96fc71fa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d0eda4-5801-4b63-8928-8eb2aa608799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d0eda4-5801-4b63-8928-8eb2aa608799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d79039-794a-409f-9bc7-a9cc22e11a4e', 'volume_name': 'volume-87d79039-794a-409f-9bc7-a9cc22e11a4e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd7b5b7-9a61-4087-95bf-dec5e16bf59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd7b5b7-9a61-4087-95bf-dec5e16bf59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a5589c-704f-489c-b944-ffb0cdcdca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:57 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Volume 87d79039-794a-409f-9bc7-a9cc22e11a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d79039-794a-409f-9bc7-a9cc22e11a4e', 'volume_size': 1} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1724083641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d79039-794a-409f-9bc7-a9cc22e11a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809437403f2f4d92be3ad266d1bbb394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:01:57Z,use_quota=True,user_id='ff7bd0f74c7f405f87045f501d785ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Creating volume 87d79039-794a-409f-9bc7-a9cc22e11a4e {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:01:57 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:01:57 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e 1073741824 Aug 26 12:01:57 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:01:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-3b8d81e8-17f5-4fb2-9777-f6b1725d4183 req-a6a72e49-d523-418f-9732-6f158c77ef3d tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:01:58 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e 1073741824" returned: 0 in 0.646s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:01:58 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e Aug 26 12:01:58 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:01:58 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e" returned: 0 in 0.362s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-3b8d81e8-17f5-4fb2-9777-f6b1725d4183 req-a6a72e49-d523-418f-9732-6f158c77ef3d tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.824s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a5589c-704f-489c-b944-ffb0cdcdca32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d79039-794a-409f-9bc7-a9cc22e11a4e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6262615e-0fe1-4fa7-b871-6baa49508ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:01:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Volume volume-87d79039-794a-409f-9bc7-a9cc22e11a4e (87d79039-794a-409f-9bc7-a9cc22e11a4e): created successfully Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6262615e-0fe1-4fa7-b871-6baa49508ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Flow 'volume_create_manager' (afb24e74-bd30-45dc-9689-0a68f38360ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-3b8d81e8-17f5-4fb2-9777-f6b1725d4183 req-a6a72e49-d523-418f-9732-6f158c77ef3d tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.125s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:01:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6237aa99-a7e5-44a2-9574-48cbe6363c23 tempest-ServerActionsTestOtherA-1762530861 None] Created volume successfully. Aug 26 12:01:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-3b8d81e8-17f5-4fb2-9777-f6b1725d4183 req-a6a72e49-d523-418f-9732-6f158c77ef3d tempest-AttachVolumeNegativeTest-1938816741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-c44298ce-b728-491a-b119-7a9b4ac7f937', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd762c54e-326a-456a-bc25-2e3351fbe2e7', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:01:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-3b8d81e8-17f5-4fb2-9777-f6b1725d4183 req-a6a72e49-d523-418f-9732-6f158c77ef3d tempest-AttachVolumeNegativeTest-1938816741 None] attachment_update completed successfully. Aug 26 12:02:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-29eab61b-f0c1-4f43-a1a0-ae47b2df0511 req-17d7673d-c89c-497d-ac15-4631943d8cb3 tempest-AttachVolumeNegativeTest-1938816741 None] Terminate volume connection completed successfully. Aug 26 12:02:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-29eab61b-f0c1-4f43-a1a0-ae47b2df0511 req-17d7673d-c89c-497d-ac15-4631943d8cb3 tempest-AttachVolumeNegativeTest-1938816741 None] Deleting attachment d762c54e-326a-456a-bc25-2e3351fbe2e7. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Flow 'volume_create_manager' (3e1d9012-fda5-4aa2-93b2-7cc841614519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4e644c-9b32-4a5c-838c-19ae4e9aedae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4e644c-9b32-4a5c-838c-19ae4e9aedae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-876350468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f2dfc5ddf74debaa9d3d9d9bd07208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:02:06Z,use_quota=True,user_id='a5d2c6e899f84c9799b62f907052b210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe654a4-e735-4fd6-a008-c3da67f4ae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe654a4-e735-4fd6-a008-c3da67f4ae4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc83dec-cfff-434c-b388-dbbe35b11e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc83dec-cfff-434c-b388-dbbe35b11e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed', 'volume_name': 'volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533f2fac-ce30-483a-bb91-298918ae3ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533f2fac-ce30-483a-bb91-298918ae3ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa79cc39-814a-4e83-9ee7-4c36e2332a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:06 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Volume f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed', 'volume_size': 1} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-876350468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f2dfc5ddf74debaa9d3d9d9bd07208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:02:06Z,use_quota=True,user_id='a5d2c6e899f84c9799b62f907052b210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Creating volume f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:02:06 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:02:06 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed 1073741824 Aug 26 12:02:06 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:02:06 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed 1073741824" returned: 0 in 0.675s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:02:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:02:06 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed Aug 26 12:02:06 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:02:07 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Aug 26 12:02:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed" returned: 0 in 0.309s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:02:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:02:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa79cc39-814a-4e83-9ee7-4c36e2332a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07277d6c-f10d-44ea-a450-6a68dd85915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:07 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Volume volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed (f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed): created successfully Aug 26 12:02:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07277d6c-f10d-44ea-a450-6a68dd85915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Flow 'volume_create_manager' (3e1d9012-fda5-4aa2-93b2-7cc841614519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:02:07 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-23125693-b8ff-4a9f-ab28-08a37a7978b8 tempest-AttachVolumeShelveTestJSON-1846085150 None] Created volume successfully. Aug 26 12:02:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:02:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:02:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:02:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:02:10 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:02:10 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:02:11 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.599s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 8 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Flow 'volume_create_manager' (1eb50544-602e-4841-b3c8-3ff83163dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c69971-acbf-4b6b-9364-1ee8bc0af7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c69971-acbf-4b6b-9364-1ee8bc0af7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-442071766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a4676f3b5648378959abc571cd42cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:02:11Z,use_quota=True,user_id='ff38b1e29c4d4e4e8f5839923ae756b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b36655-5628-4061-9884-c2e553eb84c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b36655-5628-4061-9884-c2e553eb84c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043c4164-0843-47c2-b64e-204a8e535564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043c4164-0843-47c2-b64e-204a8e535564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d', 'volume_name': 'volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7a350f-483d-493b-b53a-2ba7deca902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7a350f-483d-493b-b53a-2ba7deca902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c43671-11c9-460b-96c8-8611e1b22fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:11 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Volume 2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d', 'volume_size': 1} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-442071766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a4676f3b5648378959abc571cd42cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:02:11Z,use_quota=True,user_id='ff38b1e29c4d4e4e8f5839923ae756b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Creating volume 2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:02:11 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:02:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:02:11 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d 1073741824 Aug 26 12:02:11 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:02:12 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Aug 26 12:02:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d 1073741824" returned: 0 in 0.761s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:02:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:02:12 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d Aug 26 12:02:12 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:02:12 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Aug 26 12:02:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d" returned: 0 in 0.574s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:02:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:02:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c43671-11c9-460b-96c8-8611e1b22fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ce5c8d-169d-43bc-bd8b-fc2ca4e2be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:13 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Volume volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d (2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d): created successfully Aug 26 12:02:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ce5c8d-169d-43bc-bd8b-fc2ca4e2be66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Flow 'volume_create_manager' (1eb50544-602e-4841-b3c8-3ff83163dfee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:02:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f0804bd4-2db5-4ca0-a347-64a9e6828abe tempest-AttachVolumeTestJSON-490957537 None] Created volume successfully. Aug 26 12:02:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-50117b23-86ee-442a-9b66-bf6b95702c6f req-c197c3cd-1a18-49a1-b810-3eaae8ac0a76 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-50117b23-86ee-442a-9b66-bf6b95702c6f req-c197c3cd-1a18-49a1-b810-3eaae8ac0a76 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-50117b23-86ee-442a-9b66-bf6b95702c6f req-c197c3cd-1a18-49a1-b810-3eaae8ac0a76 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-50117b23-86ee-442a-9b66-bf6b95702c6f req-c197c3cd-1a18-49a1-b810-3eaae8ac0a76 tempest-AttachVolumeTestJSON-490957537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21b4b080-5963-4f7d-996a-d7871b7e515e', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:02:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-50117b23-86ee-442a-9b66-bf6b95702c6f req-c197c3cd-1a18-49a1-b810-3eaae8ac0a76 tempest-AttachVolumeTestJSON-490957537 None] attachment_update completed successfully. Aug 26 12:02:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-75104471-4c35-417e-bd83-00f1965f2a7a req-c9e5a290-e3aa-4ca5-b0ab-25ee3cfa65d6 tempest-AttachVolumeShelveTestJSON-1846085150 None] No connector for attachment aef3c0d2-26de-4805-921c-1ffa3f39bd86; skipping storage backend terminate_connection call. {{(pid=94387) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 26 12:02:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-75104471-4c35-417e-bd83-00f1965f2a7a req-c9e5a290-e3aa-4ca5-b0ab-25ee3cfa65d6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Deleting attachment aef3c0d2-26de-4805-921c-1ffa3f39bd86. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:02:34 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=19,cinder:SELECT=17,cinder:INSERT=3,cinder:DELETE=2 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:02:34 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=30,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:02:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-f1d6e0e7-d0c7-4cf1-af23-b48b3586a969 req-c78bdc1f-04ab-44a4-ab76-19dd9b474e3a tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-f1d6e0e7-d0c7-4cf1-af23-b48b3586a969 req-c78bdc1f-04ab-44a4-ab76-19dd9b474e3a tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-f1d6e0e7-d0c7-4cf1-af23-b48b3586a969 req-c78bdc1f-04ab-44a4-ab76-19dd9b474e3a tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-f1d6e0e7-d0c7-4cf1-af23-b48b3586a969 req-c78bdc1f-04ab-44a4-ab76-19dd9b474e3a tempest-ServerActionsTestOtherA-1762530861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-87d79039-794a-409f-9bc7-a9cc22e11a4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83c03dbc-ea97-485e-871c-1d371baca08b', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:02:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-f1d6e0e7-d0c7-4cf1-af23-b48b3586a969 req-c78bdc1f-04ab-44a4-ab76-19dd9b474e3a tempest-ServerActionsTestOtherA-1762530861 None] attachment_update completed successfully. Aug 26 12:02:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-82ecca63-2f0e-43e5-bd4a-3e950f300ccb req-7d74f582-6c21-49b4-9d1c-fb1d9cc6d848 tempest-ServerActionsTestOtherA-1762530861 None] Terminate volume connection completed successfully. Aug 26 12:02:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-82ecca63-2f0e-43e5-bd4a-3e950f300ccb req-7d74f582-6c21-49b4-9d1c-fb1d9cc6d848 tempest-ServerActionsTestOtherA-1762530861 None] Deleting attachment 83c03dbc-ea97-485e-871c-1d371baca08b. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:02:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-82ecca63-2f0e-43e5-bd4a-3e950f300ccb req-e5654ccd-6de9-4ff6-b209-068b80a4f707 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-82ecca63-2f0e-43e5-bd4a-3e950f300ccb req-e5654ccd-6de9-4ff6-b209-068b80a4f707 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-82ecca63-2f0e-43e5-bd4a-3e950f300ccb req-e5654ccd-6de9-4ff6-b209-068b80a4f707 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-82ecca63-2f0e-43e5-bd4a-3e950f300ccb req-e5654ccd-6de9-4ff6-b209-068b80a4f707 tempest-ServerActionsTestOtherA-1762530861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-87d79039-794a-409f-9bc7-a9cc22e11a4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed517688-eec9-45a1-ac81-51b25a0e93db', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:02:41 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-82ecca63-2f0e-43e5-bd4a-3e950f300ccb req-e5654ccd-6de9-4ff6-b209-068b80a4f707 tempest-ServerActionsTestOtherA-1762530861 None] attachment_update completed successfully. Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Flow 'volume_create_manager' (d0d07b9a-dbf1-46b5-b292-476df8291a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed976ff6-de3c-4707-acbf-cb0afb19aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed976ff6-de3c-4707-acbf-cb0afb19aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-990535609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9329f00c-e91a-49d3-90a7-878a5426a3cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487fcb35425543c69015c010587b94dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:02:49Z,use_quota=True,user_id='5dec49a8c8fd461aa9dbf31951106abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35615372-cbbe-4b86-b4d8-9bc38b7e61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35615372-cbbe-4b86-b4d8-9bc38b7e61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2b3a06-22b0-481c-b3b7-4453ab0b5a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2b3a06-22b0-481c-b3b7-4453ab0b5a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9329f00c-e91a-49d3-90a7-878a5426a3cf', 'volume_name': 'volume-9329f00c-e91a-49d3-90a7-878a5426a3cf', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fefcf1-8958-4aec-af5d-8e7b5af973bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fefcf1-8958-4aec-af5d-8e7b5af973bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187c791f-9d1d-49c2-9434-c4aee14fa5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:49 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Volume 9329f00c-e91a-49d3-90a7-878a5426a3cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9329f00c-e91a-49d3-90a7-878a5426a3cf', 'volume_size': 1} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-990535609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9329f00c-e91a-49d3-90a7-878a5426a3cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487fcb35425543c69015c010587b94dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:02:49Z,use_quota=True,user_id='5dec49a8c8fd461aa9dbf31951106abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Creating volume 9329f00c-e91a-49d3-90a7-878a5426a3cf {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:02:49 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:02:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:02:49 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf 1073741824 Aug 26 12:02:49 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:02:50 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Aug 26 12:02:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf 1073741824" returned: 0 in 0.580s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:02:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:02:50 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf Aug 26 12:02:50 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:02:50 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Aug 26 12:02:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf" returned: 0 in 0.454s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:02:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:02:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187c791f-9d1d-49c2-9434-c4aee14fa5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9329f00c-e91a-49d3-90a7-878a5426a3cf', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a91ad9c-71b1-43c5-bf7c-deab758b4e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:02:50 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Volume volume-9329f00c-e91a-49d3-90a7-878a5426a3cf (9329f00c-e91a-49d3-90a7-878a5426a3cf): created successfully Aug 26 12:02:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a91ad9c-71b1-43c5-bf7c-deab758b4e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:02:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Flow 'volume_create_manager' (d0d07b9a-dbf1-46b5-b292-476df8291a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:02:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f9f854e4-d5e8-447f-a367-8ecaa4e3c8be tempest-AttachVolumeNegativeTest-1938816741 None] Created volume successfully. Aug 26 12:02:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-137c2cd2-b8d8-4480-a299-184818f31024 req-158b7b04-2d99-47f6-99aa-94e8473e7088 tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:02:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-137c2cd2-b8d8-4480-a299-184818f31024 req-158b7b04-2d99-47f6-99aa-94e8473e7088 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:02:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-137c2cd2-b8d8-4480-a299-184818f31024 req-158b7b04-2d99-47f6-99aa-94e8473e7088 tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:02:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-137c2cd2-b8d8-4480-a299-184818f31024 req-158b7b04-2d99-47f6-99aa-94e8473e7088 tempest-AttachVolumeNegativeTest-1938816741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-9329f00c-e91a-49d3-90a7-878a5426a3cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f685543b-9a11-4f95-8472-8150d02ef8f3', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:02:53 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-137c2cd2-b8d8-4480-a299-184818f31024 req-158b7b04-2d99-47f6-99aa-94e8473e7088 tempest-AttachVolumeNegativeTest-1938816741 None] attachment_update completed successfully. Aug 26 12:02:55 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-e7be977a-1b4f-4609-9463-7a563358ba27 req-2c9c3e77-10fd-49b0-a0d8-f5e18aed4eaa tempest-AttachVolumeNegativeTest-1938816741 None] Terminate volume connection completed successfully. Aug 26 12:02:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-e7be977a-1b4f-4609-9463-7a563358ba27 req-2c9c3e77-10fd-49b0-a0d8-f5e18aed4eaa tempest-AttachVolumeNegativeTest-1938816741 None] Deleting attachment f685543b-9a11-4f95-8472-8150d02ef8f3. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:03:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "cinder-9329f00c-e91a-49d3-90a7-878a5426a3cf-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-9329f00c-e91a-49d3-90a7-878a5426a3cf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "cinder-quobyte-9329f00c-e91a-49d3-90a7-878a5426a3cf" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-quobyte-9329f00c-e91a-49d3-90a7-878a5426a3cf" acquired by "delete_volume" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:01 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c74b8ed-81ee-4566-9ee3-cae253990c55]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:01 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf Aug 26 12:03:01 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:01 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf" returned: 0 in 0.372s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:01 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf Aug 26 12:03:01 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:02 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9329f00c-e91a-49d3-90a7-878a5426a3cf" returned: 0 in 0.262s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-quobyte-9329f00c-e91a-49d3-90a7-878a5426a3cf" released by "delete_volume" :: held 0.673s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Created reservations ['c11df228-58f7-4c38-9f07-89f56cc3bb9c', 'cac1064e-2595-453b-8ae4-03fd577a7263', '0e8a3aa2-4d4a-496f-8eb3-67078b2f75b5', 'fbdd9e49-c8d2-49a7-9ac5-741e7bcab330'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:02 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:03:02 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:02 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:03:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Deleted volume successfully. Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5a60e148-0f62-43db-8391-5adbc257b72f tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-9329f00c-e91a-49d3-90a7-878a5426a3cf-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "cinder-c44298ce-b728-491a-b119-7a9b4ac7f937-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-c44298ce-b728-491a-b119-7a9b4ac7f937-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "cinder-quobyte-c44298ce-b728-491a-b119-7a9b4ac7f937" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-quobyte-c44298ce-b728-491a-b119-7a9b4ac7f937" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa2e2b2-3451-46a6-a473-6213203115b2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:02 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937 Aug 26 12:03:02 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:03 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937" returned: 0 in 0.361s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:03 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937 Aug 26 12:03:03 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:03 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c44298ce-b728-491a-b119-7a9b4ac7f937" returned: 0 in 0.275s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-quobyte-c44298ce-b728-491a-b119-7a9b4ac7f937" released by "delete_volume" :: held 0.685s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Created reservations ['6646dc07-604a-4005-9c09-70edace3a531', '43d9761a-3c6d-40fd-8c27-e327aa8a57c1', '14ba07b8-6ea4-444e-a373-2f6b3197b4c9', '418c4184-d504-4ec9-8979-9e5cb4528222'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:03 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:03:03 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:03 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.305s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:03:03 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Deleted volume successfully. Aug 26 12:03:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b76519e3-af96-4b54-8164-d9f55191dcac tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-c44298ce-b728-491a-b119-7a9b4ac7f937-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "cinder-9991dc40-96d7-4a72-bc97-49856e085766-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-9991dc40-96d7-4a72-bc97-49856e085766-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "cinder-quobyte-9991dc40-96d7-4a72-bc97-49856e085766" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-quobyte-9991dc40-96d7-4a72-bc97-49856e085766" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:04 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5df053c-642c-4cc7-b02d-58626d9996e4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:04 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766 Aug 26 12:03:04 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:04 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766" returned: 0 in 0.428s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:04 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766 Aug 26 12:03:04 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:05 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9991dc40-96d7-4a72-bc97-49856e085766" returned: 0 in 0.266s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-quobyte-9991dc40-96d7-4a72-bc97-49856e085766" released by "delete_volume" :: held 0.743s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Created reservations ['4a311bf7-b8df-4474-b458-2421e07449ab', '1a033829-eff6-4d5d-ae18-e0764a41d4fc', '3d5418c5-7bfc-4617-ab50-a0a9d375c195', '949c2316-7114-41c4-872d-997ca6e1b05f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:05 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:03:05 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:05 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.339s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:03:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Deleted volume successfully. Aug 26 12:03:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-423d861d-878a-4634-a58b-56fb78f592ad tempest-AttachVolumeNegativeTest-1938816741 None] Lock "cinder-9991dc40-96d7-4a72-bc97-49856e085766-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:06 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-b77f8a91-428d-433b-bb0c-bd3d08de7cd5 req-819a44d3-4093-4b1f-b4f3-ac84184f4859 tempest-AttachVolumeTestJSON-490957537 None] Terminate volume connection completed successfully. Aug 26 12:03:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-b77f8a91-428d-433b-bb0c-bd3d08de7cd5 req-819a44d3-4093-4b1f-b4f3-ac84184f4859 tempest-AttachVolumeTestJSON-490957537 None] Deleting attachment 21b4b080-5963-4f7d-996a-d7871b7e515e. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:03:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Acquiring lock "cinder-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "cinder-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Acquiring lock "cinder-quobyte-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "cinder-quobyte-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:08 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f40f02f-ed3b-452b-bd7d-dce4950b4483]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:08 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed Aug 26 12:03:08 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:09 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed" returned: 0 in 0.368s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:09 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed Aug 26 12:03:09 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:09 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed" returned: 0 in 0.261s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "cinder-quobyte-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed" released by "delete_volume" :: held 0.681s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Created reservations ['fe974970-b2a3-429c-88cb-1bb7c5ed9c45', '296b9662-eddc-4f9d-acc8-d63b2e173a1b', 'd12337fb-d780-4cc3-abb6-1fdfcec1cd55', '760e0205-2956-48e9-bdb0-94f8c1de858e'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:09 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:03:09 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:10 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.386s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:03:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Deleted volume successfully. Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f52ed3fa-44d6-4c5a-938c-39d6763e40f6 tempest-AttachVolumeShelveTestJSON-1846085150 None] Lock "cinder-f72090ed-9fdf-4c0f-b84d-d12ebb83e3ed-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:10 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:03:10 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:10 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 8 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:03:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:03:11 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-74453008-4363-4ede-ab33-cf84094a53c9 req-4fb164dd-7146-4978-95fa-f539985fa3bd tempest-ServerActionsTestOtherA-1762530861 None] Terminate volume connection completed successfully. Aug 26 12:03:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-74453008-4363-4ede-ab33-cf84094a53c9 req-4fb164dd-7146-4978-95fa-f539985fa3bd tempest-ServerActionsTestOtherA-1762530861 None] Deleting attachment ed517688-eec9-45a1-ac81-51b25a0e93db. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Flow 'volume_create_manager' (653b1681-4191-4ab7-8725-654199f92809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c20257-78e7-446d-8a3d-5435602f68b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c20257-78e7-446d-8a3d-5435602f68b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1505984507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ea0bde-8398-40f2-9ef5-e2da5dd1d42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24ad2a305d4ef2a664e07daa711c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:03:17Z,use_quota=True,user_id='bb5087edb88f42f08dc09335f4227b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad19e64-aa72-4619-9b3d-897c8dededaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad19e64-aa72-4619-9b3d-897c8dededaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87b8859-45a9-4d07-a305-24a88068429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87b8859-45a9-4d07-a305-24a88068429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ea0bde-8398-40f2-9ef5-e2da5dd1d42f', 'volume_name': 'volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c75945-b78f-4c74-8b9e-f82250c1c7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c75945-b78f-4c74-8b9e-f82250c1c7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe8ec24-faf1-4c72-b588-b1ed065aaddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Volume 11ea0bde-8398-40f2-9ef5-e2da5dd1d42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f', 'volume_size': 1} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1505984507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ea0bde-8398-40f2-9ef5-e2da5dd1d42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24ad2a305d4ef2a664e07daa711c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:03:17Z,use_quota=True,user_id='bb5087edb88f42f08dc09335f4227b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Creating volume 11ea0bde-8398-40f2-9ef5-e2da5dd1d42f {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:03:17 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:03:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:17 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f 1073741824 Aug 26 12:03:17 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:18 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f 1073741824" returned: 0 in 0.851s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:18 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f Aug 26 12:03:18 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:18 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" returned: 0 in 0.416s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:03:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe8ec24-faf1-4c72-b588-b1ed065aaddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0307539-94eb-46b6-9128-cafd25256d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:18 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Volume volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f (11ea0bde-8398-40f2-9ef5-e2da5dd1d42f): created successfully Aug 26 12:03:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0307539-94eb-46b6-9128-cafd25256d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Flow 'volume_create_manager' (653b1681-4191-4ab7-8725-654199f92809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:03:18 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-df4eb28c-df11-488b-9017-e82cd07331e5 req-01841eb5-4fbd-4974-9c8b-88fc007176fc tempest-VolumesSnapshotsTestJSON-329990254 None] Created volume successfully. Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Creating offline snapshot 921e0719-c4a4-4400-8d7c-476897fbfde6 of volume 11ea0bde-8398-40f2-9ef5-e2da5dd1d42f {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ef883-8825-4bf4-b37c-360bd5e2c03c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:20 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f Aug 26 12:03:20 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:20 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" returned: 0 in 0.497s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:20 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 1G Aug 26 12:03:20 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Flow 'volume_create_manager' (0707b465-2711-4d20-aa20-39a80aad9196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2010af58-2a89-4edc-9e27-c219bca449b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2010af58-2a89-4edc-9e27-c219bca449b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1382542618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eeee6f9-891e-415d-8763-8e62376d833a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809437403f2f4d92be3ad266d1bbb394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:03:21Z,use_quota=True,user_id='ff7bd0f74c7f405f87045f501d785ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ac0b47-ed34-4a82-a696-2099ec3e7a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ac0b47-ed34-4a82-a696-2099ec3e7a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b58eb9b-48c4-4be9-9f74-6a97121d9720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:20 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:03:21 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 1G" returned: 0 in 0.477s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:21 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 Aug 26 12:03:21 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:21 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6" returned: 0 in 0.380s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:21 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 is being set with open permissions: ugo+rw Aug 26 12:03:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:21 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 Aug 26 12:03:21 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:21 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6" returned: 0 in 0.338s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:21 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.info Aug 26 12:03:21 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b58eb9b-48c4-4be9-9f74-6a97121d9720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1eeee6f9-891e-415d-8763-8e62376d833a', 'volume_name': 'volume-1eeee6f9-891e-415d-8763-8e62376d833a', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5267273c-e872-403d-9ad6-97855202a5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5267273c-e872-403d-9ad6-97855202a5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4e0294-910a-48d5-8f73-e54a95a1d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:22 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Volume 1eeee6f9-891e-415d-8763-8e62376d833a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1eeee6f9-891e-415d-8763-8e62376d833a', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Trying to clone 1eeee6f9-891e-415d-8763-8e62376d833a from image 014b1010-45ca-42a7-a54b-7655e36f8066 at location (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:03:22 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.info" returned: 0 in 0.307s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:22 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.info is being set with open permissions: ugo+rw Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:22 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.info Aug 26 12:03:22 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:22 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:03:22 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Image download 20.69 MB at 20.69 MB/s Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.info" returned: 0 in 0.430s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adfbd5e-592a-444d-9784-8e67aced7a83]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:22 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-7d19bf00-eb60-4a1f-8087-1a383f4e547a req-5413ee1e-5f23-4853-aaa0-459d1e25aede tempest-VolumesSnapshotsTestJSON-329990254 None] Create snapshot completed successfully Aug 26 12:03:22 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD Aug 26 12:03:22 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Acquiring lock "cinder-921e0719-c4a4-4400-8d7c-476897fbfde6-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-921e0719-c4a4-4400-8d7c-476897fbfde6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Acquiring lock "cinder-quobyte-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-quobyte-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Acquiring lock "cinder-quobyte-921e0719-c4a4-4400-8d7c-476897fbfde6" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-quobyte-921e0719-c4a4-4400-8d7c-476897fbfde6" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Deleting offline snapshot 921e0719-c4a4-4400-8d7c-476897fbfde6 of volume 11ea0bde-8398-40f2-9ef5-e2da5dd1d42f {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] snapshot_file for this snap is: volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dddeb5-b08a-49f8-9203-9fedc3db1591]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d24f6d15-f8ed-468c-b7f0-30e4f6441e6b tempest-BackendsCapabilitiesAdminTestsJSON-837280358 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8016510009766, 'free_capacity_gb': 1774.8016510009766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94387) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 12:03:23 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 is fetched for user ff7bd0f74c7f405f87045f501d785ea2. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1a01fb7c-9f48-4508-b7a9-89094924a22c tempest-BackendsCapabilitiesAdminTestsJSON-837280358 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8016510009766, 'free_capacity_gb': 1774.8016510009766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94387) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 12:03:23 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 Aug 26 12:03:23 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7015116-93f7-47c0-a2ba-3795ee6aae4a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:23 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD Aug 26 12:03:23 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:23 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6" returned: 0 in 0.490s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[467fe3a1-1b12-44a2-a71e-49a1530bb376]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:23 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1382542618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eeee6f9-891e-415d-8763-8e62376d833a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809437403f2f4d92be3ad266d1bbb394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:03:21Z,use_quota=True,user_id='ff7bd0f74c7f405f87045f501d785ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Creating volume 1eeee6f9-891e-415d-8763-8e62376d833a {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:03:23 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:03:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:23 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f Aug 26 12:03:23 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:23 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a 1073741824 Aug 26 12:03:23 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:24 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" returned: 0 in 0.515s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:24 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 Aug 26 12:03:24 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:24 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a 1073741824" returned: 0 in 0.533s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:24 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a Aug 26 12:03:24 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:24 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6" returned: 0 in 0.484s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:24 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6 Aug 26 12:03:24 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:24 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a" returned: 0 in 0.358s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Attempting download of 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume 1eeee6f9-891e-415d-8763-8e62376d833a. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbdf163-a5c0-4952-9335-46c114ea4b03]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5p1b_9zt {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:25 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f.921e0719-c4a4-4400-8d7c-476897fbfde6" returned: 0 in 0.379s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:25 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5p1b_9zt Aug 26 12:03:25 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-quobyte-921e0719-c4a4-4400-8d7c-476897fbfde6" released by "_delete_snapshot" :: held 2.019s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-quobyte-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" released by "delete_snapshot" :: held 2.065s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:25 devstack cinder-volume[94387]: WARNING cinder.quota [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG cinder.quota [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Created reservations ['ffb55e6e-bb49-4c04-885a-8bea42aa1447', '4c0fac6a-cbab-4e62-9170-34373bbd5681', 'ac9df1b6-6bd8-460c-bad3-5e9d15c78357', '129a2281-9edb-47ef-b975-9dc1edfc9431'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:03:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Delete snapshot completed successfully. Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-654954f3-e97f-4b59-92e4-ccbbbb8d8ff5 req-e7dbc283-c737-412a-8f47-924eed6f02d5 tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-921e0719-c4a4-4400-8d7c-476897fbfde6-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:25 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Acquiring lock "cinder-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5p1b_9zt" returned: 0 in 0.528s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5p1b_9zt {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Acquiring lock "cinder-quobyte-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-quobyte-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" acquired by "delete_volume" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:25 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5p1b_9zt Aug 26 12:03:25 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2e2d3a-8093-4763-91cb-6c33c7e9bc49]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:25 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f Aug 26 12:03:25 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:25 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5p1b_9zt" returned: 1 in 0.454s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5p1b_9zt' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebad4e6-a743-44c4-8635-925cb0c40beb]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:26 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD Aug 26 12:03:26 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:26 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" returned: 0 in 0.542s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:26 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f Aug 26 12:03:26 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:26 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] 014b1010-45ca-42a7-a54b-7655e36f8066 was qcow2, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:26 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a Aug 26 12:03:26 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:26 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" returned: 0 in 0.301s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-quobyte-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f" released by "delete_volume" :: held 0.953s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG cinder.quota [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Created reservations ['a6b07f77-d998-4b2b-b3ab-09e6fb8ce657', '1f8ddf95-3583-481d-8dd2-05023618bee0', '36c64e8d-7acd-43d7-a04a-8ab60f25d506', 'ed388939-8e6b-4874-b731-6757dc025f07'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:26 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:03:26 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:27 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.272s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:27 devstack cinder-volume[94387]: DEBUG cinder.manager [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:03:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Deleted volume successfully. Aug 26 12:03:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-c006a91f-4a0d-4f7b-9dbc-3fadfc9173ee req-7f2c4504-a796-4112-a0b8-f401fc2b222e tempest-VolumesSnapshotsTestJSON-329990254 None] Lock "cinder-11ea0bde-8398-40f2-9ef5-e2da5dd1d42f-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:28 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a" returned: 0 in 2.334s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:28 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_6to45v3hdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:03:28 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Converted 112.00 MB image at 47.97 MB/s Aug 26 12:03:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:28 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a 1G Aug 26 12:03:28 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:29 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a 1G" returned: 0 in 0.456s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Downloaded image 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume 1eeee6f9-891e-415d-8763-8e62376d833a successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 for user ff7bd0f74c7f405f87045f501d785ea2 is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Marking volume 1eeee6f9-891e-415d-8763-8e62376d833a as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Copying metadata from image 014b1010-45ca-42a7-a54b-7655e36f8066 to 1eeee6f9-891e-415d-8763-8e62376d833a. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Creating volume glance metadata for volume 1eeee6f9-891e-415d-8763-8e62376d833a backed by image 014b1010-45ca-42a7-a54b-7655e36f8066 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4e0294-910a-48d5-8f73-e54a95a1d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eeee6f9-891e-415d-8763-8e62376d833a', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9555c881-17e2-46f5-949b-d7b4f3a674dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:29 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Volume volume-1eeee6f9-891e-415d-8763-8e62376d833a (1eeee6f9-891e-415d-8763-8e62376d833a): created successfully Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9555c881-17e2-46f5-949b-d7b4f3a674dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Flow 'volume_create_manager' (0707b465-2711-4d20-aa20-39a80aad9196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:03:29 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-00eb22ac-09ea-45c7-9da3-a6114f545728 tempest-ServerActionsTestOtherA-1762530861 None] Created volume successfully. Aug 26 12:03:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-708696e4-b583-41b8-835e-6528d9678f37 tempest-GroupSnapshotsV319Test-800017327 None] Group tempest-GroupSnapshotsV319Test-Group-1935016851: creating Aug 26 12:03:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-708696e4-b583-41b8-835e-6528d9678f37 tempest-GroupSnapshotsV319Test-800017327 None] Group tempest-GroupSnapshotsV319Test-Group-1935016851: created successfully Aug 26 12:03:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-708696e4-b583-41b8-835e-6528d9678f37 tempest-GroupSnapshotsV319Test-800017327 None] Create group completed successfully. Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Flow 'volume_create_manager' (a535c11d-bb9e-4da5-9a33-0efb879ef3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b0356a-e574-4757-8460-198c6de43d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b0356a-e574-4757-8460-198c6de43d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1650403592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=391dbbe3-beb5-48b7-b524-6d3d92787562,host='devstack@QuobyteHD#QuobyteHD',id=2875a9f4-6f21-416d-a610-bedf32d6213c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401d6effee64ab2989fdeebdc5c37f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:03:32Z,use_quota=True,user_id='531e849ec1b644e3ae0bbef790ea1144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04ca6ab4-7909-4de3-af8d-a6623ee7a78a),volume_type_id=04ca6ab4-7909-4de3-af8d-a6623ee7a78a)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8c6117-15c0-47d7-9c2e-9afc27fcade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8c6117-15c0-47d7-9c2e-9afc27fcade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a534d1-a0ac-4595-9bdf-3daeb0b80656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a534d1-a0ac-4595-9bdf-3daeb0b80656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2875a9f4-6f21-416d-a610-bedf32d6213c', 'volume_name': 'volume-2875a9f4-6f21-416d-a610-bedf32d6213c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2447ce01-8889-479d-a7eb-5ac5a8835f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2447ce01-8889-479d-a7eb-5ac5a8835f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416fc1c8-eeef-4108-b18e-c9f98039749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:32 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Volume 2875a9f4-6f21-416d-a610-bedf32d6213c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2875a9f4-6f21-416d-a610-bedf32d6213c', 'volume_size': 1} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=391dbbe3-beb5-48b7-b524-6d3d92787562,created_at=2026-08-26T10:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1650403592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=391dbbe3-beb5-48b7-b524-6d3d92787562,host='devstack@QuobyteHD#QuobyteHD',id=2875a9f4-6f21-416d-a610-bedf32d6213c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401d6effee64ab2989fdeebdc5c37f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:03:32Z,use_quota=True,user_id='531e849ec1b644e3ae0bbef790ea1144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04ca6ab4-7909-4de3-af8d-a6623ee7a78a),volume_type_id=04ca6ab4-7909-4de3-af8d-a6623ee7a78a)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Creating volume 2875a9f4-6f21-416d-a610-bedf32d6213c {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:03:32 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:32 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c 1073741824 Aug 26 12:03:32 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-55f36b16-2079-49b3-b4ae-8e82e8be77c8 req-68cd93ce-a550-41a1-97f4-1292a9b41a38 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:32 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c 1073741824" returned: 0 in 0.655s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:33 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c Aug 26 12:03:33 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:33 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c" returned: 0 in 0.342s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-55f36b16-2079-49b3-b4ae-8e82e8be77c8 req-68cd93ce-a550-41a1-97f4-1292a9b41a38 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.691s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416fc1c8-eeef-4108-b18e-c9f98039749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2875a9f4-6f21-416d-a610-bedf32d6213c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2733ad7-88ba-4d6d-822d-661136b9791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-55f36b16-2079-49b3-b4ae-8e82e8be77c8 req-68cd93ce-a550-41a1-97f4-1292a9b41a38 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:33 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Volume volume-2875a9f4-6f21-416d-a610-bedf32d6213c (2875a9f4-6f21-416d-a610-bedf32d6213c): created successfully Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2733ad7-88ba-4d6d-822d-661136b9791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Flow 'volume_create_manager' (a535c11d-bb9e-4da5-9a33-0efb879ef3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:03:33 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-16cb4c3c-514e-4606-9e27-687f903a8ca1 tempest-GroupSnapshotsV319Test-800017327 None] Created volume successfully. Aug 26 12:03:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-55f36b16-2079-49b3-b4ae-8e82e8be77c8 req-68cd93ce-a550-41a1-97f4-1292a9b41a38 tempest-ServerActionsTestOtherA-1762530861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-1eeee6f9-891e-415d-8763-8e62376d833a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8dfc266e-4278-4c97-a38f-a91e43389a3b', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:03:33 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-55f36b16-2079-49b3-b4ae-8e82e8be77c8 req-68cd93ce-a550-41a1-97f4-1292a9b41a38 tempest-ServerActionsTestOtherA-1762530861 None] attachment_update completed successfully. Aug 26 12:03:35 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] GroupSnapshot 062f7f82-2e5a-449d-9ae0-27596bffbf09: creating. Aug 26 12:03:35 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=86,cinder:UPDATE=68,cinder:DELETE=6,cinder:INSERT=18 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:03:35 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=78,cinder:UPDATE=67,cinder:INSERT=24,cinder:DELETE=4 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:03:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Group snapshot 062f7f82-2e5a-449d-9ae0-27596bffbf09: creating. {{(pid=94387) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 12:03:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Creating offline snapshot c668ba78-3832-499d-9f18-339e4d17cdeb of volume 2875a9f4-6f21-416d-a610-bedf32d6213c {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:03:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a9915f-688d-4ed5-a34a-4982785cf7bf]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:35 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c Aug 26 12:03:35 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:36 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c" returned: 0 in 0.813s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:36 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb 1G Aug 26 12:03:36 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:36 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb 1G" returned: 0 in 0.847s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2875a9f4-6f21-416d-a610-bedf32d6213c -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:36 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2875a9f4-6f21-416d-a610-bedf32d6213c -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb Aug 26 12:03:36 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:37 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2875a9f4-6f21-416d-a610-bedf32d6213c -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb" returned: 0 in 0.375s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:37 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:03:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:37 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb Aug 26 12:03:37 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:37 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb" returned: 0 in 0.339s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:37 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.info Aug 26 12:03:37 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:38 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.info" returned: 0 in 0.451s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:38 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:03:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:38 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.info Aug 26 12:03:38 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:38 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.info" returned: 0 in 0.420s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.390s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:38 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1462b55f-329f-4897-8f9a-78a0507262ce tempest-GroupSnapshotsTest-318453926 None] Group tempest-GroupSnapshotsTest-Group-1035043539: creating Aug 26 12:03:38 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1462b55f-329f-4897-8f9a-78a0507262ce tempest-GroupSnapshotsTest-318453926 None] Group tempest-GroupSnapshotsTest-Group-1035043539: created successfully Aug 26 12:03:38 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1462b55f-329f-4897-8f9a-78a0507262ce tempest-GroupSnapshotsTest-318453926 None] Create group completed successfully. Aug 26 12:03:38 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-11084765-f5b1-4496-b3a8-4ad5d23e7c7d tempest-GroupSnapshotsV319Test-800017327 None] group_snapshot 062f7f82-2e5a-449d-9ae0-27596bffbf09: created successfully Aug 26 12:03:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] group_snapshot 062f7f82-2e5a-449d-9ae0-27596bffbf09: deleting Aug 26 12:03:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] group_snapshot 062f7f82-2e5a-449d-9ae0-27596bffbf09: deleting {{(pid=94387) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 12:03:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Acquiring lock "cinder-quobyte-2875a9f4-6f21-416d-a610-bedf32d6213c" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Lock "cinder-quobyte-2875a9f4-6f21-416d-a610-bedf32d6213c" acquired by "delete_snapshot" :: waited 0.088s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Acquiring lock "cinder-quobyte-c668ba78-3832-499d-9f18-339e4d17cdeb" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Lock "cinder-quobyte-c668ba78-3832-499d-9f18-339e4d17cdeb" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Deleting offline snapshot c668ba78-3832-499d-9f18-339e4d17cdeb of volume 2875a9f4-6f21-416d-a610-bedf32d6213c {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:03:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] snapshot_file for this snap is: volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:03:40 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae5d65c-790e-485d-ba1b-75ffcde939d7]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:40 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb Aug 26 12:03:40 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Flow 'volume_create_manager' (35f7397f-b1b8-49b2-86f4-4a8721612236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63f545a-8ceb-473f-97b5-f4cb180441b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63f545a-8ceb-473f-97b5-f4cb180441b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1565570235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eac103a-bd86-4e16-932c-b4fe38c159d2,host='devstack@QuobyteHD#QuobyteHD',id=e8bd17ac-b151-41d0-a95b-d9e8960b622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c6c25e8c4464c888f6a318a2de05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:03:41Z,use_quota=True,user_id='ece8b5dba8164ac082f737bbd50250c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37962f34-6062-4c93-a21a-e104e40b09a5),volume_type_id=37962f34-6062-4c93-a21a-e104e40b09a5)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43888cf1-3435-4606-a240-269ff332a8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43888cf1-3435-4606-a240-269ff332a8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867907e4-a535-4eb3-ba6f-007cce3dd805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867907e4-a535-4eb3-ba6f-007cce3dd805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8bd17ac-b151-41d0-a95b-d9e8960b622d', 'volume_name': 'volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f5f9b-5f4d-48e3-9065-f14a5c28907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f5f9b-5f4d-48e3-9065-f14a5c28907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:41 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d137909-db56-4c0b-ae93-7116d61fe839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:41 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Volume e8bd17ac-b151-41d0-a95b-d9e8960b622d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d', 'volume_size': 1} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3eac103a-bd86-4e16-932c-b4fe38c159d2,created_at=2026-08-26T10:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1565570235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eac103a-bd86-4e16-932c-b4fe38c159d2,host='devstack@QuobyteHD#QuobyteHD',id=e8bd17ac-b151-41d0-a95b-d9e8960b622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c6c25e8c4464c888f6a318a2de05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:03:41Z,use_quota=True,user_id='ece8b5dba8164ac082f737bbd50250c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37962f34-6062-4c93-a21a-e104e40b09a5),volume_type_id=37962f34-6062-4c93-a21a-e104e40b09a5)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Creating volume e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:03:41 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb" returned: 0 in 1.080s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2875a9f4-6f21-416d-a610-bedf32d6213c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:03:41 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d 1073741824 Aug 26 12:03:41 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a40c491-dee6-4ee9-8907-94a6d8eb79fd]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:42 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c Aug 26 12:03:42 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:42 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:42 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c" returned: 0 in 0.719s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d 1073741824" returned: 0 in 0.823s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:42 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb Aug 26 12:03:42 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:42 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d Aug 26 12:03:42 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:43 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d" returned: 0 in 0.772s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d137909-db56-4c0b-ae93-7116d61fe839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b10579-e65e-465f-9475-58b8ce1c0ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:03:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Volume volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d (e8bd17ac-b151-41d0-a95b-d9e8960b622d): created successfully Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b10579-e65e-465f-9475-58b8ce1c0ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:03:43 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Flow 'volume_create_manager' (35f7397f-b1b8-49b2-86f4-4a8721612236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb" returned: 0 in 0.979s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-efc45bf6-4612-45d6-9cb8-dc6578cb5a4e tempest-GroupSnapshotsTest-318453926 None] Created volume successfully. Aug 26 12:03:43 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb Aug 26 12:03:43 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:43 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c.c668ba78-3832-499d-9f18-339e4d17cdeb" returned: 0 in 0.443s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Lock "cinder-quobyte-c668ba78-3832-499d-9f18-339e4d17cdeb" released by "_delete_snapshot" :: held 3.478s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Lock "cinder-quobyte-2875a9f4-6f21-416d-a610-bedf32d6213c" released by "delete_snapshot" :: held 3.554s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:44 devstack cinder-volume[94387]: WARNING cinder.quota [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-325279266 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-325279266, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:03:44 devstack cinder-volume[94387]: WARNING cinder.quota [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-325279266 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-325279266, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:03:44 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] Created reservations ['d31e2d44-56ea-45b9-8f5a-fc27c25500f0', 'ed2c9ab8-647f-4999-9eaf-2710901c12d7', 'fc6c4f64-a022-4651-a96b-2e81709c8da1', '93d0a35d-90d9-48c0-b0ab-c172cf343fdb'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:03:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-adad46ca-feb5-4770-a3a5-61d4a2658fa0 tempest-GroupSnapshotsV319Test-800017327 None] group_snapshot 062f7f82-2e5a-449d-9ae0-27596bffbf09: deleted successfully Aug 26 12:03:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] GroupSnapshot a40f9ddb-2658-4571-b61f-e002f97e1add: creating. Aug 26 12:03:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Group snapshot a40f9ddb-2658-4571-b61f-e002f97e1add: creating. {{(pid=94387) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 12:03:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Creating offline snapshot 2f08cbec-d209-4e26-b5f3-4e6902f5d719 of volume e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:03:45 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e4a328-a375-4e13-a2a0-35f50cc68a7e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:45 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d Aug 26 12:03:45 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Acquiring lock "cinder-quobyte-2875a9f4-6f21-416d-a610-bedf32d6213c" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Lock "cinder-quobyte-2875a9f4-6f21-416d-a610-bedf32d6213c" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:45 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae1a988-e49e-4631-919a-68a89cb002ba]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:45 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d" returned: 0 in 0.846s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:45 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c Aug 26 12:03:45 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:45 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 1G Aug 26 12:03:46 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:46 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c" returned: 0 in 0.658s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:46 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c Aug 26 12:03:46 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:46 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 1G" returned: 0 in 0.854s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:46 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 Aug 26 12:03:46 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:46 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2875a9f4-6f21-416d-a610-bedf32d6213c" returned: 0 in 0.533s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Lock "cinder-quobyte-2875a9f4-6f21-416d-a610-bedf32d6213c" released by "delete_volume" :: held 1.346s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Created reservations ['5df93655-4f1c-46de-840f-25c639370536'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:03:47 devstack cinder-volume[94387]: WARNING cinder.quota [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-325279266 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-325279266, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Created reservations ['7c76dd70-3804-4e03-af3c-c9164ed24423', 'd5b7493b-edf5-436b-8ace-71f0cac84035', '2ea2abef-00c1-49c1-aa0a-6c75b1d13259', '33d4fcf8-7646-4c4f-9d73-b565df3f60fe'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:03:47 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719" returned: 0 in 0.607s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:47 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:47 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 Aug 26 12:03:47 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:47 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:03:47 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:47 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719" returned: 0 in 0.384s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:47 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.info Aug 26 12:03:47 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:47 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.422s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:47 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:03:47 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-cfa3c2c8-438c-4101-8250-911bdfd98930 tempest-GroupSnapshotsV319Test-800017327 None] Delete group completed successfully. Aug 26 12:03:48 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.info" returned: 0 in 0.421s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:48 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:03:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:48 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.info Aug 26 12:03:48 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:48 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.info" returned: 0 in 0.489s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.759s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6134d476-3bc0-4dbc-8531-41cbc7223d99 tempest-GroupSnapshotsTest-318453926 None] group_snapshot a40f9ddb-2658-4571-b61f-e002f97e1add: created successfully Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-2f08cbec-d209-4e26-b5f3-4e6902f5d719-705454ba-c2cb-4820-9928-191abc99e7d5" by "_create_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-2f08cbec-d209-4e26-b5f3-4e6902f5d719-705454ba-c2cb-4820-9928-191abc99e7d5" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Creating volume 705454ba-c2cb-4820-9928-191abc99e7d5 from snapshot 2f08cbec-d209-4e26-b5f3-4e6902f5d719 {{(pid=94387) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-705454ba-c2cb-4820-9928-191abc99e7d5" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-705454ba-c2cb-4820-9928-191abc99e7d5" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] snapshot: 2f08cbec-d209-4e26-b5f3-4e6902f5d719, volume: 705454ba-c2cb-4820-9928-191abc99e7d5, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e37fe3-3eb5-4a11-a48a-aa8f4df8271a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:51 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 Aug 26 12:03:51 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:51 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719" returned: 0 in 0.829s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:03:51 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[618f62a7-3205-4c24-b3a5-602ab5f34b7c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:03:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:52 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d Aug 26 12:03:52 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:52 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Aug 26 12:03:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d" returned: 0 in 1.028s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:03:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:03:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:03:52 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:03:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:03:52 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 Aug 26 12:03:52 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:03:55 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-ab64e455-7709-4c5c-8bdf-a194758eb64c req-ec224818-e0e4-45e7-9f7e-e561ac720536 tempest-ServerActionsTestOtherA-1762530861 None] Terminate volume connection completed successfully. Aug 26 12:03:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-ab64e455-7709-4c5c-8bdf-a194758eb64c req-ec224818-e0e4-45e7-9f7e-e561ac720536 tempest-ServerActionsTestOtherA-1762530861 None] Deleting attachment 8dfc266e-4278-4c97-a38f-a91e43389a3b. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:04:00 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5" returned: 0 in 7.605s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:00 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:04:00 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Converted 1024.00 MB image at 134.61 MB/s Aug 26 12:04:00 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:04:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:00 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 Aug 26 12:04:00 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:00 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-705454ba-c2cb-4820-9928-191abc99e7d5" released by "_copy_volume_from_snapshot" :: held 9.989s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-2f08cbec-d209-4e26-b5f3-4e6902f5d719-705454ba-c2cb-4820-9928-191abc99e7d5" released by "_create_volume_from_snapshot" :: held 10.112s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.151s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:01 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4e658272-5049-4078-9d98-c7a3dd85570a tempest-GroupSnapshotsTest-318453926 None] Create group from source-snapshot-a40f9ddb-2658-4571-b61f-e002f97e1add completed successfully. Aug 26 12:04:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-ab64e455-7709-4c5c-8bdf-a194758eb64c req-22cb9bb1-5afc-477b-9b91-f3447af3dd5c tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-ab64e455-7709-4c5c-8bdf-a194758eb64c req-22cb9bb1-5afc-477b-9b91-f3447af3dd5c tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-ab64e455-7709-4c5c-8bdf-a194758eb64c req-22cb9bb1-5afc-477b-9b91-f3447af3dd5c tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-ab64e455-7709-4c5c-8bdf-a194758eb64c req-22cb9bb1-5afc-477b-9b91-f3447af3dd5c tempest-ServerActionsTestOtherA-1762530861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-1eeee6f9-891e-415d-8763-8e62376d833a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70dfe682-66a7-4f8d-babb-24a26d80d09b', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:04:01 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-ab64e455-7709-4c5c-8bdf-a194758eb64c req-22cb9bb1-5afc-477b-9b91-f3447af3dd5c tempest-ServerActionsTestOtherA-1762530861 None] attachment_update completed successfully. Aug 26 12:04:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-705454ba-c2cb-4820-9928-191abc99e7d5" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-705454ba-c2cb-4820-9928-191abc99e7d5" acquired by "delete_volume" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:03 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cad807-7431-4af3-bf38-42deef02ea0c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:03 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 Aug 26 12:04:03 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:03 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5" returned: 0 in 0.727s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:03 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5 Aug 26 12:04:03 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:04 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-705454ba-c2cb-4820-9928-191abc99e7d5" returned: 0 in 0.403s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-705454ba-c2cb-4820-9928-191abc99e7d5" released by "delete_volume" :: held 1.233s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['6131f87c-9e41-4b0a-9abe-59b7e1142f4b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:04 devstack cinder-volume[94387]: WARNING cinder.quota [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1735137711 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1735137711, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:04:04 devstack cinder-volume[94387]: WARNING cinder.quota [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1735137711 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1735137711, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['6fba193f-fdf9-48cf-a09b-249de29435ee', '482192a0-9638-43b0-9915-5add4b418ff0', 'd3fe495b-1e5e-49b7-8096-2a74c5bca083', '62dea5ac-6861-407f-848d-162b20347894'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:04 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:04 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:04 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.356s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:04 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:04 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6665cf21-e982-448c-b5fb-4b45412e25b0 tempest-GroupSnapshotsTest-318453926 None] Delete group completed successfully. Aug 26 12:04:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] group_snapshot a40f9ddb-2658-4571-b61f-e002f97e1add: deleting Aug 26 12:04:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] group_snapshot a40f9ddb-2658-4571-b61f-e002f97e1add: deleting {{(pid=94387) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 12:04:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-e8bd17ac-b151-41d0-a95b-d9e8960b622d" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-e8bd17ac-b151-41d0-a95b-d9e8960b622d" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-2f08cbec-d209-4e26-b5f3-4e6902f5d719" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-2f08cbec-d209-4e26-b5f3-4e6902f5d719" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Deleting offline snapshot 2f08cbec-d209-4e26-b5f3-4e6902f5d719 of volume e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:04:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] snapshot_file for this snap is: volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:04:05 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4496848-5d20-46ba-9b55-0465f34c3040]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:06 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 Aug 26 12:04:06 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:06 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719" returned: 0 in 0.642s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:06 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[275fb3ef-fc7c-4501-b242-a0de164133cf]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:06 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d Aug 26 12:04:06 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:07 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d" returned: 0 in 1.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:07 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 Aug 26 12:04:07 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:08 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719" returned: 0 in 0.763s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:08 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719 Aug 26 12:04:08 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:09 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d.2f08cbec-d209-4e26-b5f3-4e6902f5d719" returned: 0 in 0.479s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-2f08cbec-d209-4e26-b5f3-4e6902f5d719" released by "_delete_snapshot" :: held 3.346s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-e8bd17ac-b151-41d0-a95b-d9e8960b622d" released by "delete_snapshot" :: held 3.408s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:09 devstack cinder-volume[94387]: WARNING cinder.quota [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1735137711 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1735137711, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:04:09 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['fdebc98a-ed0b-4ee5-b50d-fa00c1033db7', '6d092e08-ee81-4103-8a42-617135ce166f', 'aa069e1f-a0f5-4a81-8399-5e1d0b82fed9', 'df4fd421-47a4-41fa-a5d1-9d98dfdbb5b9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:09 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-818b67d3-1250-492a-a26b-5507eebeba54 tempest-GroupSnapshotsTest-318453926 None] group_snapshot a40f9ddb-2658-4571-b61f-e002f97e1add: deleted successfully Aug 26 12:04:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:04:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:10 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:10 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-e8bd17ac-b151-41d0-a95b-d9e8960b622d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-e8bd17ac-b151-41d0-a95b-d9e8960b622d" acquired by "delete_volume" :: waited 0.033s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:11 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf363c08-e7d4-4afa-a126-bb566efd2e60]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:11 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.927s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:11 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:04:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:04:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:04:11 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d Aug 26 12:04:11 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:12 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d" returned: 0 in 0.928s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:12 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d Aug 26 12:04:12 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:12 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e8bd17ac-b151-41d0-a95b-d9e8960b622d" returned: 0 in 0.732s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-e8bd17ac-b151-41d0-a95b-d9e8960b622d" released by "delete_volume" :: held 1.840s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:13 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['4c727ccc-97c1-46bb-9de7-7440b06d7e87'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:13 devstack cinder-volume[94387]: WARNING cinder.db.api [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1735137711'] Aug 26 12:04:13 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['f470d7ca-2e05-43da-ba23-f4c01d86a4b0', '3998184f-61c5-43ba-afe7-e353985429d0', 'efebdc7e-0f4d-41b4-b3f4-78b4e5fb94e8', '9a754edb-d0dd-4b18-91a2-18c8fcebcffe'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:13 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:13 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:14 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.411s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:14 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e0055b63-774b-48ab-9aad-9cec11c5f039 tempest-GroupSnapshotsTest-318453926 None] Delete group completed successfully. Aug 26 12:04:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d3d44287-5de0-45cc-82b8-8d52e8037ade tempest-GroupSnapshotsTest-318453926 None] Group tempest-GroupSnapshotsTest-Group-826728249: creating Aug 26 12:04:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d3d44287-5de0-45cc-82b8-8d52e8037ade tempest-GroupSnapshotsTest-318453926 None] Group tempest-GroupSnapshotsTest-Group-826728249: created successfully Aug 26 12:04:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d3d44287-5de0-45cc-82b8-8d52e8037ade tempest-GroupSnapshotsTest-318453926 None] Create group completed successfully. Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Flow 'volume_create_manager' (f2329144-28e0-4535-8533-243130a53adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93675dee-ecb2-4391-a449-28160c1325e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93675dee-ecb2-4391-a449-28160c1325e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1644440658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a827a85-f4ba-453a-ab51-db6c4c96cb58,host='devstack@QuobyteHD#QuobyteHD',id=5c859425-b888-4463-aad4-9e1b7a29aa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c6c25e8c4464c888f6a318a2de05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:17Z,use_quota=True,user_id='ece8b5dba8164ac082f737bbd50250c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b157d7-2d5a-42e5-acb7-9cc1b5f44fa7),volume_type_id=e3b157d7-2d5a-42e5-acb7-9cc1b5f44fa7)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8490816-f95f-48e2-b82f-9a748cf7908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8490816-f95f-48e2-b82f-9a748cf7908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363d839d-3157-4e5e-8ba9-6af2b8841bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363d839d-3157-4e5e-8ba9-6af2b8841bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c859425-b888-4463-aad4-9e1b7a29aa91', 'volume_name': 'volume-5c859425-b888-4463-aad4-9e1b7a29aa91', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d107f704-f26e-4a75-95af-03fcd3e228ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d107f704-f26e-4a75-95af-03fcd3e228ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9677b004-1141-407e-9b1f-447bbdcb51aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Volume 5c859425-b888-4463-aad4-9e1b7a29aa91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c859425-b888-4463-aad4-9e1b7a29aa91', 'volume_size': 1} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a827a85-f4ba-453a-ab51-db6c4c96cb58,created_at=2026-08-26T10:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1644440658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a827a85-f4ba-453a-ab51-db6c4c96cb58,host='devstack@QuobyteHD#QuobyteHD',id=5c859425-b888-4463-aad4-9e1b7a29aa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c6c25e8c4464c888f6a318a2de05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:17Z,use_quota=True,user_id='ece8b5dba8164ac082f737bbd50250c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b157d7-2d5a-42e5-acb7-9cc1b5f44fa7),volume_type_id=e3b157d7-2d5a-42e5-acb7-9cc1b5f44fa7)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Creating volume 5c859425-b888-4463-aad4-9e1b7a29aa91 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:04:17 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:17 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 1073741824 Aug 26 12:04:17 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:17 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 1073741824" returned: 0 in 0.534s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:17 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 Aug 26 12:04:17 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:18 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91" returned: 0 in 0.427s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:04:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9677b004-1141-407e-9b1f-447bbdcb51aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c859425-b888-4463-aad4-9e1b7a29aa91', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f1bfe4-1b30-462a-8d02-9f19edb3e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:18 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Volume volume-5c859425-b888-4463-aad4-9e1b7a29aa91 (5c859425-b888-4463-aad4-9e1b7a29aa91): created successfully Aug 26 12:04:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f1bfe4-1b30-462a-8d02-9f19edb3e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Flow 'volume_create_manager' (f2329144-28e0-4535-8533-243130a53adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:18 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-00a1681e-0401-4101-807d-77466bd53cf8 tempest-GroupSnapshotsTest-318453926 None] Created volume successfully. Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Flow 'volume_create_manager' (1ee29020-642f-48bf-89c0-e2bc26970efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a66126-656e-4d8a-af94-b8261fa85b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a66126-656e-4d8a-af94-b8261fa85b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742233772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a827a85-f4ba-453a-ab51-db6c4c96cb58,host='devstack@QuobyteHD#QuobyteHD',id=0baa2e85-4443-4c3b-ba5a-13826e18d075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c6c25e8c4464c888f6a318a2de05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:19Z,use_quota=True,user_id='ece8b5dba8164ac082f737bbd50250c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b157d7-2d5a-42e5-acb7-9cc1b5f44fa7),volume_type_id=e3b157d7-2d5a-42e5-acb7-9cc1b5f44fa7)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19c7777-60e4-4773-928f-f7bdb7c22669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19c7777-60e4-4773-928f-f7bdb7c22669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f51b58f-1227-4de2-8d60-e26bb1d62888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f51b58f-1227-4de2-8d60-e26bb1d62888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0baa2e85-4443-4c3b-ba5a-13826e18d075', 'volume_name': 'volume-0baa2e85-4443-4c3b-ba5a-13826e18d075', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fb751a-b26b-403f-ba30-7a630539f041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fb751a-b26b-403f-ba30-7a630539f041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57f58cf-a37b-49b9-91cc-bf6af81dffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:19 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Volume 0baa2e85-4443-4c3b-ba5a-13826e18d075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0baa2e85-4443-4c3b-ba5a-13826e18d075', 'volume_size': 1} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a827a85-f4ba-453a-ab51-db6c4c96cb58,created_at=2026-08-26T10:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742233772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a827a85-f4ba-453a-ab51-db6c4c96cb58,host='devstack@QuobyteHD#QuobyteHD',id=0baa2e85-4443-4c3b-ba5a-13826e18d075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c6c25e8c4464c888f6a318a2de05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:19Z,use_quota=True,user_id='ece8b5dba8164ac082f737bbd50250c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b157d7-2d5a-42e5-acb7-9cc1b5f44fa7),volume_type_id=e3b157d7-2d5a-42e5-acb7-9cc1b5f44fa7)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Creating volume 0baa2e85-4443-4c3b-ba5a-13826e18d075 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:04:19 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:04:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:19 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 1073741824 Aug 26 12:04:19 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:20 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 1073741824" returned: 0 in 0.580s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:20 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 Aug 26 12:04:20 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Flow 'volume_create_manager' (1a4082b5-eaed-4a6d-84b9-bd06ae465389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab191b51-a93f-4f4e-b700-2917f485a8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab191b51-a93f-4f4e-b700-2917f485a8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-631599407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918d6420-0fe6-473c-8bb1-0835aae1508a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6582a3c2124ccfa5a2e68e620d89ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:20Z,use_quota=True,user_id='4b217c477d7446c4b9816c47241656f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a32ca40-a5c8-4e61-b955-989291fc2ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a32ca40-a5c8-4e61-b955-989291fc2ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ccb358-70ce-4a1a-a979-d795771af7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ccb358-70ce-4a1a-a979-d795771af7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918d6420-0fe6-473c-8bb1-0835aae1508a', 'volume_name': 'volume-918d6420-0fe6-473c-8bb1-0835aae1508a', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5e9a3c-e31d-483f-a569-1475bd981b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5e9a3c-e31d-483f-a569-1475bd981b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:20 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53515931-4ed4-49da-a420-7d99c3082ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:20 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Volume 918d6420-0fe6-473c-8bb1-0835aae1508a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918d6420-0fe6-473c-8bb1-0835aae1508a', 'volume_size': 1} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075" returned: 0 in 0.500s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-631599407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918d6420-0fe6-473c-8bb1-0835aae1508a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6582a3c2124ccfa5a2e68e620d89ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:20Z,use_quota=True,user_id='4b217c477d7446c4b9816c47241656f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Creating volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:04:20 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57f58cf-a37b-49b9-91cc-bf6af81dffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0baa2e85-4443-4c3b-ba5a-13826e18d075', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:20 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a 1073741824 Aug 26 12:04:20 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5333ed-1935-4b10-96e8-1fa1f5d862a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:20 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Volume volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 (0baa2e85-4443-4c3b-ba5a-13826e18d075): created successfully Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5333ed-1935-4b10-96e8-1fa1f5d862a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Flow 'volume_create_manager' (1ee29020-642f-48bf-89c0-e2bc26970efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:20 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4eac4a11-474e-4c3d-9995-93e397452523 tempest-GroupSnapshotsTest-318453926 None] Created volume successfully. Aug 26 12:04:21 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a 1073741824" returned: 0 in 0.469s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:21 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a Aug 26 12:04:21 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:21 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a" returned: 0 in 0.358s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:04:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53515931-4ed4-49da-a420-7d99c3082ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918d6420-0fe6-473c-8bb1-0835aae1508a', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d234efdc-a9b4-4742-8e18-5563b5384acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:21 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Volume volume-918d6420-0fe6-473c-8bb1-0835aae1508a (918d6420-0fe6-473c-8bb1-0835aae1508a): created successfully Aug 26 12:04:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d234efdc-a9b4-4742-8e18-5563b5384acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Flow 'volume_create_manager' (1a4082b5-eaed-4a6d-84b9-bd06ae465389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-33a578cd-d851-4fd0-9555-d39bfa234d3d tempest-SnapshotsActionsTest-234330385 None] Created volume successfully. Aug 26 12:04:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-aabdbc1d-82a8-4efe-a0f8-71884d415aff tempest-GroupSnapshotsTest-318453926 None] Update group completed successfully. Aug 26 12:04:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Creating offline snapshot fb0f1162-6535-47ee-8aa0-1707d107cb2e of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:04:22 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125dcee-e7d9-418e-b605-65e1981aa4ea]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:22 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a Aug 26 12:04:22 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:23 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a" returned: 0 in 0.406s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:23 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e 1G Aug 26 12:04:23 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-27aec698-52b6-4531-abad-3f2be0c96be8 tempest-GroupSnapshotsTest-318453926 None] Update group completed successfully. Aug 26 12:04:23 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e 1G" returned: 0 in 0.397s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:23 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:23 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:23 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.302s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:23 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e is being set with open permissions: ugo+rw Aug 26 12:04:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:23 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:23 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:24 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.249s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:24 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.info Aug 26 12:04:24 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:24 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-aeca591b-9c9e-4752-bfc1-3d74fe1f525f tempest-GroupSnapshotsTest-318453926 None] Update group completed successfully. Aug 26 12:04:24 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.info" returned: 0 in 0.277s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:24 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.info is being set with open permissions: ugo+rw Aug 26 12:04:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:24 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.info Aug 26 12:04:24 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:24 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.info" returned: 0 in 0.264s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:24 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0a91d20f-ce4a-4db8-b5fc-9d539e7cf9a8 tempest-SnapshotsActionsTest-234330385 None] Create snapshot completed successfully Aug 26 12:04:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Creating offline snapshot 7ff6680c-539b-4519-ac48-e5536c6c08b6 of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:04:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c21b6ee-9cf7-485f-9586-66a298b83791]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e8ca4686-c693-400a-b20b-dc5426f8e992 tempest-GroupSnapshotsTest-318453926 None] Update group completed successfully. Aug 26 12:04:25 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:25 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:26 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.527s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:26 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 1G Aug 26 12:04:26 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:26 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 1G" returned: 0 in 0.548s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:26 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 Aug 26 12:04:26 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:26 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6" returned: 0 in 0.322s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:26 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 is being set with open permissions: ugo+rw Aug 26 12:04:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:26 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 Aug 26 12:04:26 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:27 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] GroupSnapshot ac342748-1d16-4278-9bd2-586f21457da7: creating. Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6" returned: 0 in 0.293s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Group snapshot ac342748-1d16-4278-9bd2-586f21457da7: creating. {{(pid=94387) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Creating offline snapshot 707efa7d-f6eb-4fb2-b9e6-ebd56603f077 of volume 5c859425-b888-4463-aad4-9e1b7a29aa91 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:04:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fa100575-9a2c-4857-a9f3-45dbb37107ca tempest-SnapshotsActionsTest-234330385 None] Create snapshot completed successfully Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7229b84d-66c7-41ae-b517-f07976bd103c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:27 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 Aug 26 12:04:27 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-7ff6680c-539b-4519-ac48-e5536c6c08b6-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-7ff6680c-539b-4519-ac48-e5536c6c08b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-quobyte-7ff6680c-539b-4519-ac48-e5536c6c08b6" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:27 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91" returned: 0 in 0.427s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-7ff6680c-539b-4519-ac48-e5536c6c08b6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Deleting offline snapshot 7ff6680c-539b-4519-ac48-e5536c6c08b6 of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:04:27 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 1G Aug 26 12:04:27 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] snapshot_file for this snap is: volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeb7935-8408-447c-b87e-c3e9446cf00d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:27 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 Aug 26 12:04:27 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:28 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6" returned: 0 in 0.411s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:28 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 1G" returned: 0 in 0.491s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c859425-b888-4463-aad4-9e1b7a29aa91 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2777260-35da-4523-b16c-97af1e496e17]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:28 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c859425-b888-4463-aad4-9e1b7a29aa91 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 Aug 26 12:04:28 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:28 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:28 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:28 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c859425-b888-4463-aad4-9e1b7a29aa91 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077" returned: 0 in 0.315s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:28 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:28 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 Aug 26 12:04:28 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:28 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.383s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:28 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 Aug 26 12:04:28 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:28 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077" returned: 0 in 0.255s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:28 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.info Aug 26 12:04:28 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:28 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6" returned: 0 in 0.384s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:29 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6 Aug 26 12:04:29 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:29 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.info" returned: 0 in 0.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:29 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:29 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.info Aug 26 12:04:29 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:29 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.7ff6680c-539b-4519-ac48-e5536c6c08b6" returned: 0 in 0.250s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-7ff6680c-539b-4519-ac48-e5536c6c08b6" released by "_delete_snapshot" :: held 1.546s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" released by "delete_snapshot" :: held 1.586s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:29 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.info" returned: 0 in 0.278s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Created reservations ['09c33ebf-e1fc-4d6a-a325-3e3642f47017', 'e7c30458-4199-4f62-b059-afe3334d5026', '278e6bc0-d07c-4029-a3ad-3387fe314f4f', '1d34d2ed-459a-4c64-bba2-9a87eed701ca'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Creating offline snapshot cc298406-ae0b-4bbd-a7a0-363910abcfa6 of volume 0baa2e85-4443-4c3b-ba5a-13826e18d075 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26756cc-85f1-43f4-8b5e-fde088e8cc50]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:29 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Delete snapshot completed successfully. Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e5d5874c-777e-4177-a466-989fed73a4b3 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-7ff6680c-539b-4519-ac48-e5536c6c08b6-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:29 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 Aug 26 12:04:29 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:29 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075" returned: 0 in 0.393s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:29 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 1G Aug 26 12:04:29 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:30 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 1G" returned: 0 in 0.428s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:30 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 Aug 26 12:04:30 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:30 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6" returned: 0 in 0.282s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:30 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:04:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:30 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 Aug 26 12:04:30 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:30 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6" returned: 0 in 0.237s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:30 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.info Aug 26 12:04:30 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:31 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.info" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:31 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:31 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.info Aug 26 12:04:31 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:31 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.info" returned: 0 in 0.261s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.213s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Creating offline snapshot db8286b5-63aa-4652-922e-5877f8d53bd5 of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2579a21-d612-42d5-8d2c-a7ec6a0b517b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:31 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6d404e1f-a3b4-4bf3-b551-54af4394948d tempest-GroupSnapshotsTest-318453926 None] group_snapshot ac342748-1d16-4278-9bd2-586f21457da7: created successfully Aug 26 12:04:31 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:31 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:31 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.404s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:04:31 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 1G Aug 26 12:04:31 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Flow 'volume_create_manager' (5add0614-7d7e-46bf-8d9d-e41b06ae7ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607c9370-3337-4e71-805e-70932e3590d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607c9370-3337-4e71-805e-70932e3590d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-517701918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f685f9-1ca4-4afc-a843-4db49e3751b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a4676f3b5648378959abc571cd42cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:32Z,use_quota=True,user_id='ff38b1e29c4d4e4e8f5839923ae756b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f02014-dcc0-4273-88de-00cc4401e2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f02014-dcc0-4273-88de-00cc4401e2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7084650f-9a8d-43b6-9371-b19b99f30521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7084650f-9a8d-43b6-9371-b19b99f30521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f685f9-1ca4-4afc-a843-4db49e3751b7', 'volume_name': 'volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d83740-90cd-42ae-ae46-b99148b36352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d83740-90cd-42ae-ae46-b99148b36352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea79bec-0c1b-4ad7-89df-5e821d1b0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:31 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Volume a5f685f9-1ca4-4afc-a843-4db49e3751b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7', 'volume_size': 1} Aug 26 12:04:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:32 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 1G" returned: 0 in 0.433s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:32 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 Aug 26 12:04:32 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:32 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5" returned: 0 in 0.307s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:32 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 is being set with open permissions: ugo+rw Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:32 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 Aug 26 12:04:32 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:32 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] group_snapshot ac342748-1d16-4278-9bd2-586f21457da7: deleting Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] group_snapshot ac342748-1d16-4278-9bd2-586f21457da7: deleting {{(pid=94387) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-5c859425-b888-4463-aad4-9e1b7a29aa91" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-5c859425-b888-4463-aad4-9e1b7a29aa91" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-707efa7d-f6eb-4fb2-b9e6-ebd56603f077" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-707efa7d-f6eb-4fb2-b9e6-ebd56603f077" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Deleting offline snapshot 707efa7d-f6eb-4fb2-b9e6-ebd56603f077 of volume 5c859425-b888-4463-aad4-9e1b7a29aa91 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] snapshot_file for this snap is: volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[044d9d0b-934a-4dea-b7c8-d5e787cb376c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:32 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5" returned: 0 in 0.255s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.538s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-517701918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f685f9-1ca4-4afc-a843-4db49e3751b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a4676f3b5648378959abc571cd42cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:32Z,use_quota=True,user_id='ff38b1e29c4d4e4e8f5839923ae756b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Creating volume a5f685f9-1ca4-4afc-a843-4db49e3751b7 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:04:32 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:04:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:32 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 1073741824 Aug 26 12:04:32 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:32 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 Aug 26 12:04:32 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:32 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-9622ee50-fc51-401d-a7a7-575830557666 tempest-SnapshotsActionsTest-234330385 None] Create snapshot completed successfully Aug 26 12:04:33 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077" returned: 0 in 0.408s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c859425-b888-4463-aad4-9e1b7a29aa91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[6531641f-b560-41b2-877b-f0b804c6b32e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:33 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 1073741824" returned: 0 in 0.469s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-db8286b5-63aa-4652-922e-5877f8d53bd5-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:33 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 Aug 26 12:04:33 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-db8286b5-63aa-4652-922e-5877f8d53bd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-quobyte-db8286b5-63aa-4652-922e-5877f8d53bd5" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-db8286b5-63aa-4652-922e-5877f8d53bd5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Deleting offline snapshot db8286b5-63aa-4652-922e-5877f8d53bd5 of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:04:33 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 Aug 26 12:04:33 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] snapshot_file for this snap is: volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[44428bfb-312d-4877-b0c3-f4b7a4208ea6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:33 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 Aug 26 12:04:33 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:33 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91" returned: 0 in 0.410s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:33 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 Aug 26 12:04:33 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:33 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7" returned: 0 in 0.273s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea79bec-0c1b-4ad7-89df-5e821d1b0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3cea4a-7497-4b22-94f8-11d9cd73e63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:33 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Volume volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 (a5f685f9-1ca4-4afc-a843-4db49e3751b7): created successfully Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3cea4a-7497-4b22-94f8-11d9cd73e63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Flow 'volume_create_manager' (5add0614-7d7e-46bf-8d9d-e41b06ae7ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:33 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8f2b19d0-8942-4715-a77c-18b788edf6ab tempest-AttachVolumeTestJSON-490957537 None] Created volume successfully. Aug 26 12:04:33 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5" returned: 0 in 0.451s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7045e03-f5de-4e57-8b29-60de717b2a45]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:34 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077" returned: 0 in 0.475s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:34 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:34 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:34 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077 Aug 26 12:04:34 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:34 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91.707efa7d-f6eb-4fb2-b9e6-ebd56603f077" returned: 0 in 0.409s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:34 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.593s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-707efa7d-f6eb-4fb2-b9e6-ebd56603f077" released by "_delete_snapshot" :: held 1.835s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-5c859425-b888-4463-aad4-9e1b7a29aa91" released by "delete_snapshot" :: held 1.869s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:34 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 Aug 26 12:04:34 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-0baa2e85-4443-4c3b-ba5a-13826e18d075" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-0baa2e85-4443-4c3b-ba5a-13826e18d075" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-cc298406-ae0b-4bbd-a7a0-363910abcfa6" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-cc298406-ae0b-4bbd-a7a0-363910abcfa6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Deleting offline snapshot cc298406-ae0b-4bbd-a7a0-363910abcfa6 of volume 0baa2e85-4443-4c3b-ba5a-13826e18d075 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] snapshot_file for this snap is: volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6e1d46-4f93-4b26-a1fc-3023d33beded]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-b7fb77bb-3d2f-41de-950f-d42f0a6e596f req-8162cd70-eab7-492e-9526-5c7defad3aa4 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-b7fb77bb-3d2f-41de-950f-d42f0a6e596f req-8162cd70-eab7-492e-9526-5c7defad3aa4 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-b7fb77bb-3d2f-41de-950f-d42f0a6e596f req-8162cd70-eab7-492e-9526-5c7defad3aa4 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-b7fb77bb-3d2f-41de-950f-d42f0a6e596f req-8162cd70-eab7-492e-9526-5c7defad3aa4 tempest-AttachVolumeTestJSON-490957537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0a8fc33-2807-4833-95d1-5bc111e1e989', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:04:34 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 Aug 26 12:04:34 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:35 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-b7fb77bb-3d2f-41de-950f-d42f0a6e596f req-8162cd70-eab7-492e-9526-5c7defad3aa4 tempest-AttachVolumeTestJSON-490957537 None] attachment_update completed successfully. Aug 26 12:04:35 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5" returned: 0 in 0.540s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:35 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5 Aug 26 12:04:35 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:35 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6" returned: 0 in 0.569s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0baa2e85-4443-4c3b-ba5a-13826e18d075(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb79cfd1-30e5-4edb-98fa-7c3c302de5b8]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:35 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.db8286b5-63aa-4652-922e-5877f8d53bd5" returned: 0 in 0.304s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-db8286b5-63aa-4652-922e-5877f8d53bd5" released by "_delete_snapshot" :: held 2.022s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" released by "delete_snapshot" :: held 2.062s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=113,cinder:UPDATE=86,cinder:INSERT=14,cinder:DELETE=4 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=117,cinder:INSERT=24,cinder:UPDATE=89,cinder:DELETE=4 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:04:35 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 Aug 26 12:04:35 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Created reservations ['ebd416c8-fb33-450d-9184-d065a8c7abc2', 'ce0234d3-579c-46ea-a845-27b8eb137768', '2fb3ec8a-0751-471f-a347-7190ea417efa', 'd714c573-40a5-418c-9ada-19821a7d9268'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:35 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Delete snapshot completed successfully. Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9401d8f8-2df1-4b7c-bfc4-a39f0a01e620 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-db8286b5-63aa-4652-922e-5877f8d53bd5-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:35 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075" returned: 0 in 0.501s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:35 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 Aug 26 12:04:35 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:36 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6" returned: 0 in 0.434s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:36 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6 Aug 26 12:04:36 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:36 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075.cc298406-ae0b-4bbd-a7a0-363910abcfa6" returned: 0 in 0.308s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-cc298406-ae0b-4bbd-a7a0-363910abcfa6" released by "_delete_snapshot" :: held 1.963s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-0baa2e85-4443-4c3b-ba5a-13826e18d075" released by "delete_snapshot" :: held 1.991s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:36 devstack cinder-volume[94387]: WARNING cinder.quota [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1600273791 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1600273791, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:04:36 devstack cinder-volume[94387]: WARNING cinder.quota [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1600273791 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1600273791, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:04:36 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['94edb307-0323-49e0-876c-548231acfd1e', '22f6ad7b-f97c-4fbf-bcc7-d4ecc439e30a', '32595dd1-8c43-4514-a1a4-653049044064', '899f1932-5442-422a-bf84-5b28d8a72ffc'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:36 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['5328e5ce-b562-4570-855b-88033e344f44', '31fe4cad-6d02-4764-922f-eaf9bbbb7680', '74ac00a4-13a4-4635-8951-fef8fcb2c002', '1f1fd573-b570-4c17-bb87-7e8ae206699e'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:37 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-81881cc1-40e1-4e28-a892-1ef44d9bb521 tempest-GroupSnapshotsTest-318453926 None] group_snapshot ac342748-1d16-4278-9bd2-586f21457da7: deleted successfully Aug 26 12:04:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Creating offline snapshot 4c945159-eadc-4ae0-83d0-7b05056c0c59 of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:04:37 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94fec91-ed11-404a-8dd9-cecff615ed75]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:37 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:37 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-0baa2e85-4443-4c3b-ba5a-13826e18d075" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-0baa2e85-4443-4c3b-ba5a-13826e18d075" acquired by "delete_volume" :: waited 0.046s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea78d750-6f83-4603-82b1-255234d25d80]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:38 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.786s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:38 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 1G Aug 26 12:04:38 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Flow 'volume_create_manager' (a0843192-551a-49a9-b49e-bf67d59d1cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1667d37-29a1-4fed-831a-52d88bbd9a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1667d37-29a1-4fed-831a-52d88bbd9a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-888751314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0f1606-9a8e-426e-9820-6ca53dbc8bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a4676f3b5648378959abc571cd42cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:38Z,use_quota=True,user_id='ff38b1e29c4d4e4e8f5839923ae756b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd477c7f-7334-40c0-8f0b-2a85e5ca5ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:38 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd477c7f-7334-40c0-8f0b-2a85e5ca5ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:38 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57efda2f-b890-486b-97e6-85084db49657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57efda2f-b890-486b-97e6-85084db49657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0f1606-9a8e-426e-9820-6ca53dbc8bcc', 'volume_name': 'volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c10c768-8b55-4fd9-ae3c-9c4a3c7905ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c10c768-8b55-4fd9-ae3c-9c4a3c7905ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742c82ea-42b8-47b6-8754-d551be13d2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:38 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Volume 5a0f1606-9a8e-426e-9820-6ca53dbc8bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc', 'volume_size': 1} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:38 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075" returned: 0 in 0.466s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:38 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075 Aug 26 12:04:38 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:38 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 1G" returned: 0 in 0.557s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:38 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 Aug 26 12:04:38 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:38 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0baa2e85-4443-4c3b-ba5a-13826e18d075" returned: 0 in 0.275s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-0baa2e85-4443-4c3b-ba5a-13826e18d075" released by "delete_volume" :: held 0.857s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-5c859425-b888-4463-aad4-9e1b7a29aa91" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-5c859425-b888-4463-aad4-9e1b7a29aa91" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f811722-a14c-46bf-b655-8fc210804f52]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:39 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59" returned: 0 in 0.358s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:39 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 is being set with open permissions: ugo+rw Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:39 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 Aug 26 12:04:39 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:39 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 Aug 26 12:04:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-6dbd0601-0689-4e30-8fdb-97cc7c3a6544 tempest-ServerActionsTestOtherA-1762530861 None] Terminate volume connection completed successfully. Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-6dbd0601-0689-4e30-8fdb-97cc7c3a6544 tempest-ServerActionsTestOtherA-1762530861 None] Deleting attachment 70dfe682-66a7-4f8d-babb-24a26d80d09b. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:04:39 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "cinder-1eeee6f9-891e-415d-8763-8e62376d833a-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Lock "cinder-1eeee6f9-891e-415d-8763-8e62376d833a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:39 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59" returned: 0 in 0.317s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:39 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-888751314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0f1606-9a8e-426e-9820-6ca53dbc8bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a4676f3b5648378959abc571cd42cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:38Z,use_quota=True,user_id='ff38b1e29c4d4e4e8f5839923ae756b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Creating volume 5a0f1606-9a8e-426e-9820-6ca53dbc8bcc {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:04:39 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91" returned: 0 in 0.515s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:39 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc 1073741824 Aug 26 12:04:39 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "cinder-quobyte-1eeee6f9-891e-415d-8763-8e62376d833a" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7f14d538-2729-4af6-8b63-14f8268a2bb6 tempest-SnapshotsActionsTest-234330385 None] Create snapshot completed successfully Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Lock "cinder-quobyte-1eeee6f9-891e-415d-8763-8e62376d833a" acquired by "delete_volume" :: waited 0.042s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:39 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91 Aug 26 12:04:39 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d2173d-1aa5-4db7-8f50-4900b65effc5]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:39 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a Aug 26 12:04:39 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:39 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5c859425-b888-4463-aad4-9e1b7a29aa91" returned: 0 in 0.371s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-5c859425-b888-4463-aad4-9e1b7a29aa91" released by "delete_volume" :: held 0.975s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:39 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['f72dc8d3-4cef-4751-b733-6a78d153174c'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc 1073741824" returned: 0 in 0.533s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:39 devstack cinder-volume[94387]: WARNING cinder.quota [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1600273791 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1600273791, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:04:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:40 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a" returned: 0 in 0.459s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:40 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc Aug 26 12:04:40 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:40 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a Aug 26 12:04:40 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['2b95bebb-bd4a-4d64-94d6-b6835cfc0328', '538d1c65-3fdc-4b88-9287-49a6e3884a8d', 'ce9f851f-7a1f-4f3d-8e96-c60f41979e65', 'fe4292fb-a642-4c9c-aaf5-3b6c7a32e8ba'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['123716a6-cf00-4356-8799-2502f1e016a5', '3e0ee6a1-b31c-495b-8b64-652307c6b708', '3e9fcd90-a04b-4a66-b6ba-8ba60a6941bd', 'ed36925d-cc92-4aa7-97d8-d00221a0e4f0'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:40 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:40 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1eeee6f9-891e-415d-8763-8e62376d833a" returned: 0 in 0.347s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc" returned: 0 in 0.377s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:40 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:40 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742c82ea-42b8-47b6-8754-d551be13d2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4a5e3a-97bc-416d-a83a-b94754a9d706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Lock "cinder-quobyte-1eeee6f9-891e-415d-8763-8e62376d833a" released by "delete_volume" :: held 0.926s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-4c945159-eadc-4ae0-83d0-7b05056c0c59-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:40 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Volume volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc (5a0f1606-9a8e-426e-9820-6ca53dbc8bcc): created successfully Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4a5e3a-97bc-416d-a83a-b94754a9d706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Flow 'volume_create_manager' (a0843192-551a-49a9-b49e-bf67d59d1cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5698dc80-b302-4cea-adb2-1308ce55ac84 tempest-AttachVolumeTestJSON-490957537 None] Created volume successfully. Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-4c945159-eadc-4ae0-83d0-7b05056c0c59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-quobyte-4c945159-eadc-4ae0-83d0-7b05056c0c59" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "cinder-87d79039-794a-409f-9bc7-a9cc22e11a4e-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-4c945159-eadc-4ae0-83d0-7b05056c0c59" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Deleting offline snapshot 4c945159-eadc-4ae0-83d0-7b05056c0c59 of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] snapshot_file for this snap is: volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:04:40 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Lock "cinder-87d79039-794a-409f-9bc7-a9cc22e11a4e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.315s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a06a4e2-da7f-4527-b93c-0c33731e78bf]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-14cd492f-7b84-4d4c-abde-d378ff705d40 tempest-GroupSnapshotsTest-318453926 None] Delete group completed successfully. Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.quota [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Created reservations ['514abc7d-fb4c-43f3-9f7b-637ee60c17bd', '9e274e65-d7ef-4dd5-b31b-c15ed4dc05b1', '6f34a35b-3a2d-4cb6-8710-fff42529e391', '4f6f0c60-537b-421b-b62e-c90afb419cd5'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "cinder-quobyte-87d79039-794a-409f-9bc7-a9cc22e11a4e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Lock "cinder-quobyte-87d79039-794a-409f-9bc7-a9cc22e11a4e" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3b6e28-ba54-462f-a789-2d75af213871]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:40 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 Aug 26 12:04:40 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:40 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:40 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:40 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e Aug 26 12:04:40 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:41 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a7a2884c-e857-41d7-b2bf-85c5efb040ae tempest-GroupSnapshotsTest-318453926 None] Group tempest-GroupSnapshotsTest-Group-1430782238: creating Aug 26 12:04:41 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a7a2884c-e857-41d7-b2bf-85c5efb040ae tempest-GroupSnapshotsTest-318453926 None] Group tempest-GroupSnapshotsTest-Group-1430782238: created successfully Aug 26 12:04:41 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a7a2884c-e857-41d7-b2bf-85c5efb040ae tempest-GroupSnapshotsTest-318453926 None] Create group completed successfully. Aug 26 12:04:41 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.313s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG cinder.manager [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:41 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Deleted volume successfully. Aug 26 12:04:41 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59" returned: 0 in 0.514s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-58a6bf18-b1f2-4dd4-8df8-c5ebefe25110 req-201ac26b-7fe9-487a-9629-997b053c9e10 tempest-ServerActionsTestOtherA-1762530861 None] Lock "cinder-1eeee6f9-891e-415d-8763-8e62376d833a-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[401bc308-a7b2-4bb6-938c-82bb3ca45dce]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:41 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e" returned: 0 in 0.499s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:41 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e Aug 26 12:04:41 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:41 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:41 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:41 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-87d79039-794a-409f-9bc7-a9cc22e11a4e" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Lock "cinder-quobyte-87d79039-794a-409f-9bc7-a9cc22e11a4e" released by "delete_volume" :: held 0.849s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:41 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.395s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:41 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 Aug 26 12:04:41 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Created reservations ['46773bd7-a28b-41d7-945a-eddde0889bbd', '6c4e6510-3552-4338-ac94-1a7be6a51491', '56023f46-1307-448a-bcfc-81a8be97ec02', 'd1a8cb5f-5c17-426d-a39c-f120cf7e66b7'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:41 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:41 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:42 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.357s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:42 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Deleted volume successfully. Aug 26 12:04:42 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59" returned: 0 in 0.551s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:42 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59 Aug 26 12:04:42 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-636a7d4c-8481-4a94-ac20-01925bc0c500 tempest-ServerActionsTestOtherA-1762530861 None] Lock "cinder-87d79039-794a-409f-9bc7-a9cc22e11a4e-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-bf1048ad-e2b7-47f1-9e9a-34564d192283 req-30c61bbf-d486-4cf0-a40f-9eb0b02dc055 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-bf1048ad-e2b7-47f1-9e9a-34564d192283 req-30c61bbf-d486-4cf0-a40f-9eb0b02dc055 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-bf1048ad-e2b7-47f1-9e9a-34564d192283 req-30c61bbf-d486-4cf0-a40f-9eb0b02dc055 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-bf1048ad-e2b7-47f1-9e9a-34564d192283 req-30c61bbf-d486-4cf0-a40f-9eb0b02dc055 tempest-AttachVolumeTestJSON-490957537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21afdb2f-a200-4d11-a99b-12d84d804f96', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:04:42 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-bf1048ad-e2b7-47f1-9e9a-34564d192283 req-30c61bbf-d486-4cf0-a40f-9eb0b02dc055 tempest-AttachVolumeTestJSON-490957537 None] attachment_update completed successfully. Aug 26 12:04:42 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.4c945159-eadc-4ae0-83d0-7b05056c0c59" returned: 0 in 0.336s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-4c945159-eadc-4ae0-83d0-7b05056c0c59" released by "_delete_snapshot" :: held 2.004s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" released by "delete_snapshot" :: held 2.071s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Created reservations ['d9ebee6d-75fc-4d83-9a9c-eb5484689350', '1711ac96-658e-410e-aaab-c0211e14d8f8', '0402d311-0dbc-4708-9b24-8b7c791d0249', '5fd86be4-16d5-493c-a383-becb257ce74a'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:42 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Delete snapshot completed successfully. Aug 26 12:04:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-103d1365-1e28-4e2f-a6b9-929f29786a03 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-4c945159-eadc-4ae0-83d0-7b05056c0c59-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Flow 'volume_create_manager' (a03efa77-2f8e-4b83-8a5e-ea1cef06c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f487e1-2212-4620-80f4-d63967ace465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f487e1-2212-4620-80f4-d63967ace465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38542905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c4cf605-4b9b-486a-867c-cb0452d4a5c8,host='devstack@QuobyteHD#QuobyteHD',id=051ec248-b3a2-4441-9c41-33e060eb6162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c6c25e8c4464c888f6a318a2de05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:43Z,use_quota=True,user_id='ece8b5dba8164ac082f737bbd50250c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbaa1be3-0b47-4f56-9e22-7492946cd06f),volume_type_id=fbaa1be3-0b47-4f56-9e22-7492946cd06f)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcc0cf9-5089-451a-a876-63ac238b7050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcc0cf9-5089-451a-a876-63ac238b7050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (674ebe14-47bd-41d1-8d44-1d6b245544e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (674ebe14-47bd-41d1-8d44-1d6b245544e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051ec248-b3a2-4441-9c41-33e060eb6162', 'volume_name': 'volume-051ec248-b3a2-4441-9c41-33e060eb6162', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cec2646-2fa2-4c71-9698-e7fbc40f2957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cec2646-2fa2-4c71-9698-e7fbc40f2957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f788be19-e473-4a0b-831b-e3703f931cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Volume 051ec248-b3a2-4441-9c41-33e060eb6162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051ec248-b3a2-4441-9c41-33e060eb6162', 'volume_size': 1} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c4cf605-4b9b-486a-867c-cb0452d4a5c8,created_at=2026-08-26T10:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38542905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c4cf605-4b9b-486a-867c-cb0452d4a5c8,host='devstack@QuobyteHD#QuobyteHD',id=051ec248-b3a2-4441-9c41-33e060eb6162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c6c25e8c4464c888f6a318a2de05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:04:43Z,use_quota=True,user_id='ece8b5dba8164ac082f737bbd50250c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbaa1be3-0b47-4f56-9e22-7492946cd06f),volume_type_id=fbaa1be3-0b47-4f56-9e22-7492946cd06f)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Creating volume 051ec248-b3a2-4441-9c41-33e060eb6162 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:04:43 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:43 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 1073741824 Aug 26 12:04:43 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:43 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 1073741824" returned: 0 in 0.607s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:44 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 Aug 26 12:04:44 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:44 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162" returned: 0 in 0.376s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.161s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Creating offline snapshot 9d3a7ee5-c869-4565-955a-98ced145b0fa of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f788be19-e473-4a0b-831b-e3703f931cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051ec248-b3a2-4441-9c41-33e060eb6162', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f5e959-0b80-41b4-bb70-02f953787b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7f30ca-d42f-4dc2-b6fa-538e2de5db95]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:44 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Volume volume-051ec248-b3a2-4441-9c41-33e060eb6162 (051ec248-b3a2-4441-9c41-33e060eb6162): created successfully Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f5e959-0b80-41b4-bb70-02f953787b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:04:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Flow 'volume_create_manager' (a03efa77-2f8e-4b83-8a5e-ea1cef06c58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:04:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-86781d26-b1b6-47c7-a3a1-88ab11ddf51c tempest-GroupSnapshotsTest-318453926 None] Created volume successfully. Aug 26 12:04:44 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:44 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:45 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.517s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:45 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa 1G Aug 26 12:04:45 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:45 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-aaf609e8-4032-47ae-ac23-cc03ec6b0399 req-216c4c1c-d2c6-4c85-b8b4-a7d2bf67158a tempest-AttachVolumeTestJSON-490957537 None] Terminate volume connection completed successfully. Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-aaf609e8-4032-47ae-ac23-cc03ec6b0399 req-216c4c1c-d2c6-4c85-b8b4-a7d2bf67158a tempest-AttachVolumeTestJSON-490957537 None] Deleting attachment e0a8fc33-2807-4833-95d1-5bc111e1e989. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:04:45 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa 1G" returned: 0 in 0.475s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:45 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa Aug 26 12:04:45 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:45 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:45 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa is being set with open permissions: ugo+rw Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:45 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa Aug 26 12:04:45 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:45 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] GroupSnapshot e5cb6230-51f4-49e0-bb16-1e8322895076: creating. Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Group snapshot e5cb6230-51f4-49e0-bb16-1e8322895076: creating. {{(pid=94387) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 12:04:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:46 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa" returned: 0 in 0.282s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.732s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.196s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Creating offline snapshot e66cfcd6-087f-4fea-817b-f5a03ca673c0 of volume 051ec248-b3a2-4441-9c41-33e060eb6162 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:04:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-40d2444b-ca91-42b8-b552-3e8484ecfef8 tempest-SnapshotsActionsTest-234330385 None] Create snapshot completed successfully Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7570259d-a327-4ed9-982a-c91ee656e0c4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:46 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 Aug 26 12:04:46 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-9d3a7ee5-c869-4565-955a-98ced145b0fa-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-9d3a7ee5-c869-4565-955a-98ced145b0fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Acquiring lock "cinder-quobyte-9d3a7ee5-c869-4565-955a-98ced145b0fa" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-9d3a7ee5-c869-4565-955a-98ced145b0fa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Deleting offline snapshot 9d3a7ee5-c869-4565-955a-98ced145b0fa of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] snapshot_file for this snap is: volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b46a5ad-d1dc-4239-ae2c-cbe1fd425c15]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:46 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162" returned: 0 in 0.508s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:46 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 1G Aug 26 12:04:46 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:46 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa Aug 26 12:04:46 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:47 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-acb650e4-3ce6-4897-958d-63110185633d req-f90a3a5d-ab12-4689-94e1-140323022e59 tempest-AttachVolumeTestJSON-490957537 None] Terminate volume connection completed successfully. Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-acb650e4-3ce6-4897-958d-63110185633d req-f90a3a5d-ab12-4689-94e1-140323022e59 tempest-AttachVolumeTestJSON-490957537 None] Deleting attachment 21afdb2f-a200-4d11-a99b-12d84d804f96. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:04:47 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa" returned: 0 in 0.502s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa8e4a-d5f4-4f75-9f11-8ed987674bd1]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:47 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 1G" returned: 0 in 0.560s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051ec248-b3a2-4441-9c41-33e060eb6162 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:47 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051ec248-b3a2-4441-9c41-33e060eb6162 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 Aug 26 12:04:47 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:47 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:47 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:47 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051ec248-b3a2-4441-9c41-33e060eb6162 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0" returned: 0 in 0.360s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:47 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:47 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.471s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:47 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 Aug 26 12:04:47 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:47 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa Aug 26 12:04:47 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:47 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0" returned: 0 in 0.264s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:47 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.info Aug 26 12:04:47 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:48 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa" returned: 0 in 0.632s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:48 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa Aug 26 12:04:48 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:48 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.info" returned: 0 in 0.422s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:48 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:48 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.info Aug 26 12:04:48 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:48 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.9d3a7ee5-c869-4565-955a-98ced145b0fa" returned: 0 in 0.371s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:48 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.info" returned: 0 in 0.319s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-9d3a7ee5-c869-4565-955a-98ced145b0fa" released by "_delete_snapshot" :: held 2.129s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" released by "delete_snapshot" :: held 2.169s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d45edcee-06b1-4f29-b5fb-b0d1715a26c4 tempest-GroupSnapshotsTest-318453926 None] group_snapshot e5cb6230-51f4-49e0-bb16-1e8322895076: created successfully Aug 26 12:04:48 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Created reservations ['58f98d6d-318d-4a67-bf10-c1b3a37b4f3c', 'ce17f63a-0932-4e92-8211-98be8292827d', 'f4a7390d-1626-49ca-aa96-6dbb05c65fe5', '6db7ddd6-48f7-44bd-acb7-a5da9101ec21'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Delete snapshot completed successfully. Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-db5afbb8-092a-450a-b7de-b521758c4d44 tempest-SnapshotsActionsTest-776772464 None] Lock "cinder-9d3a7ee5-c869-4565-955a-98ced145b0fa-delete_snapshot" released by "delete_snapshot" :: held 2.503s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] group_snapshot e5cb6230-51f4-49e0-bb16-1e8322895076: deleting Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] group_snapshot e5cb6230-51f4-49e0-bb16-1e8322895076: deleting {{(pid=94387) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-051ec248-b3a2-4441-9c41-33e060eb6162" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-051ec248-b3a2-4441-9c41-33e060eb6162" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-e66cfcd6-087f-4fea-817b-f5a03ca673c0" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-e66cfcd6-087f-4fea-817b-f5a03ca673c0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Deleting offline snapshot e66cfcd6-087f-4fea-817b-f5a03ca673c0 of volume 051ec248-b3a2-4441-9c41-33e060eb6162 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] snapshot_file for this snap is: volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c859a0-2f0a-43b7-963c-d32bc717f28d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:49 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 Aug 26 12:04:49 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:50 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0" returned: 0 in 0.643s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051ec248-b3a2-4441-9c41-33e060eb6162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e9267-dd33-4de5-8f6e-54cae5df61f3]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "cinder-fb0f1162-6535-47ee-8aa0-1707d107cb2e-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-fb0f1162-6535-47ee-8aa0-1707d107cb2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "cinder-quobyte-fb0f1162-6535-47ee-8aa0-1707d107cb2e" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-quobyte-fb0f1162-6535-47ee-8aa0-1707d107cb2e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Deleting offline snapshot fb0f1162-6535-47ee-8aa0-1707d107cb2e of volume 918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] snapshot_file for this snap is: volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:04:50 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 Aug 26 12:04:50 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3144a1-74bc-4d49-916d-72216202142b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:50 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:50 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:50 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162" returned: 0 in 0.475s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:50 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 Aug 26 12:04:50 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:50 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.396s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918d6420-0fe6-473c-8bb1-0835aae1508a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1dc290-6cbd-4b70-8d10-850d58d088f7]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:50 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a Aug 26 12:04:50 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:51 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0" returned: 0 in 0.568s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:51 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0 Aug 26 12:04:51 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:51 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a" returned: 0 in 0.537s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:51 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:51 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:51 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162.e66cfcd6-087f-4fea-817b-f5a03ca673c0" returned: 0 in 0.398s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-e66cfcd6-087f-4fea-817b-f5a03ca673c0" released by "_delete_snapshot" :: held 2.234s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-051ec248-b3a2-4441-9c41-33e060eb6162" released by "delete_snapshot" :: held 2.261s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:51 devstack cinder-volume[94387]: WARNING cinder.quota [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-410375574 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-410375574, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:04:51 devstack cinder-volume[94387]: WARNING cinder.quota [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-410375574 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-410375574, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['ceea9f75-ee0f-47df-b581-9e870548adc7', '5297cca0-2c23-4507-abff-2e95cd6355e9', 'd8545c4d-0401-41b9-8770-107ca950b736', '387e299d-8db7-4bca-bb71-4c49537e2427'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:51 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.528s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-bef9e8b8-f025-423f-b799-c6c4b7b60916 tempest-GroupSnapshotsTest-318453926 None] group_snapshot e5cb6230-51f4-49e0-bb16-1e8322895076: deleted successfully Aug 26 12:04:51 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e Aug 26 12:04:51 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:52 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a.fb0f1162-6535-47ee-8aa0-1707d107cb2e" returned: 0 in 0.370s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-quobyte-fb0f1162-6535-47ee-8aa0-1707d107cb2e" released by "_delete_snapshot" :: held 1.964s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" released by "delete_snapshot" :: held 1.987s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:52 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Created reservations ['3046b25c-168b-43ee-a95d-ae44878ee096', '8f7b701e-0e16-44de-8ab8-45835be0a7e1', 'd11b1120-a5a5-4cde-9200-3fdd91479240', '12cbbbc1-aa67-4637-a3f5-0a48289ccab7'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:52 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Delete snapshot completed successfully. Aug 26 12:04:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-619a9faa-855d-4c5c-b2c8-a4a71966aa4f tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-fb0f1162-6535-47ee-8aa0-1707d107cb2e-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "cinder-quobyte-051ec248-b3a2-4441-9c41-33e060eb6162" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-051ec248-b3a2-4441-9c41-33e060eb6162" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f835b073-90ec-47b3-ad0a-6b5236dcab2e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:53 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 Aug 26 12:04:53 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "cinder-918d6420-0fe6-473c-8bb1-0835aae1508a-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-918d6420-0fe6-473c-8bb1-0835aae1508a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" acquired by "delete_volume" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2269129a-ecfc-4d33-ba35-a55a03fe365f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "cinder-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:53 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a Aug 26 12:04:53 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:53 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162" returned: 0 in 0.546s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "cinder-quobyte-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:53 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162 Aug 26 12:04:53 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-quobyte-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc" acquired by "delete_volume" :: waited 0.034s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a4879-7d97-44f5-8ae9-54465f74bd3d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:54 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc Aug 26 12:04:54 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:54 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051ec248-b3a2-4441-9c41-33e060eb6162" returned: 0 in 0.306s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:54 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a" returned: 0 in 0.492s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Lock "cinder-quobyte-051ec248-b3a2-4441-9c41-33e060eb6162" released by "delete_volume" :: held 0.982s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:54 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a Aug 26 12:04:54 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['51a77ccf-7f4a-46fd-a0b7-823b2d0aef2e'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:54 devstack cinder-volume[94387]: WARNING cinder.quota [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-410375574 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-410375574, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Created reservations ['cec5e72a-f529-4ed1-b6a0-253d6c6a2597', '8e5b138d-ca63-453e-95cc-790feb51ceb6', '855e9e22-871b-4187-82e2-973a6df57821', 'c6440a96-2f4e-4cc0-8ce5-febb04e0ec0d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:54 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc" returned: 0 in 0.477s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:54 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc Aug 26 12:04:54 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:54 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:54 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:54 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-918d6420-0fe6-473c-8bb1-0835aae1508a" returned: 0 in 0.416s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-quobyte-918d6420-0fe6-473c-8bb1-0835aae1508a" released by "delete_volume" :: held 0.999s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:54 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Created reservations ['4334b095-af34-479c-84be-39bb8ada6a80', 'e2e04dbf-4302-4252-9008-27b574fc575d', '0aaf20ec-680e-46da-9da6-00f920558908', '69e1a577-0a8b-4705-b989-84b212b6380b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-quobyte-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc" released by "delete_volume" :: held 0.821s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Created reservations ['9dc91e09-bcca-4fd0-87fe-792a2733aec2', '9911eed4-8832-429e-a1b6-57ed0d858ec3', 'f3d79165-bc82-435a-a36c-21f2f1f816c5', '9618fdd7-d9ff-4f97-8871-9b27ce5ddf86'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:54 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.336s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:54 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:54 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-54b0cbda-f7b5-497d-8928-db7b0696d882 tempest-GroupSnapshotsTest-318453926 None] Delete group completed successfully. Aug 26 12:04:54 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:54 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:55 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:55 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:55 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.304s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:55 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Deleted volume successfully. Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d3f0f78-6073-4185-9051-d39425bb36e3 tempest-SnapshotsActionsTest-234330385 None] Lock "cinder-918d6420-0fe6-473c-8bb1-0835aae1508a-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:55 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:55 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Deleted volume successfully. Aug 26 12:04:55 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18e99bb6-a4eb-4de5-974a-ffa0dbe9e280 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-5a0f1606-9a8e-426e-9820-6ca53dbc8bcc-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "cinder-a5f685f9-1ca4-4afc-a843-4db49e3751b7-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-a5f685f9-1ca4-4afc-a843-4db49e3751b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "cinder-quobyte-a5f685f9-1ca4-4afc-a843-4db49e3751b7" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-quobyte-a5f685f9-1ca4-4afc-a843-4db49e3751b7" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:56 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[db98a350-8b1a-416f-b26c-eb91b51d72c0]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:56 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 Aug 26 12:04:56 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:56 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7" returned: 0 in 0.463s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:56 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7 Aug 26 12:04:56 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:57 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5f685f9-1ca4-4afc-a843-4db49e3751b7" returned: 0 in 0.303s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-quobyte-a5f685f9-1ca4-4afc-a843-4db49e3751b7" released by "delete_volume" :: held 0.825s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Created reservations ['72fa4d2b-b780-4498-8fb4-13c6108b910d', 'dbc29d4a-e951-4255-a95e-ba5da0e1b7d5', '661bf6bd-5d34-4b43-aad6-a8be5077de2a', 'ac09b193-4840-4334-8acf-e334a158d5f5'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:57 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:57 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "cinder-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "cinder-quobyte-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-quobyte-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d" acquired by "delete_volume" :: waited 0.035s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:04:57 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.408s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e408d21-2151-4bd7-9dc8-3ea4a90233fe]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:57 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Deleted volume successfully. Aug 26 12:04:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-80618bdd-b82f-4ed5-8f4b-8d84154ada01 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-a5f685f9-1ca4-4afc-a843-4db49e3751b7-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:57 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d Aug 26 12:04:57 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:58 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d" returned: 0 in 0.437s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:58 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d Aug 26 12:04:58 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:58 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d" returned: 0 in 0.251s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-quobyte-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d" released by "delete_volume" :: held 0.742s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Created reservations ['690e1b4f-ee4c-45ed-bdfe-05c1f1319940', '49308512-ea36-4ea2-97ae-dbc5bdd514d2', 'edce0bbb-9175-4ab4-8dca-60321b2eaa87', 'f248a1a1-d24c-4bbd-8f0f-55ddcc76034b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:04:58 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:04:58 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:04:58 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.270s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:04:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Deleted volume successfully. Aug 26 12:04:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2aa93aa3-6344-4fe1-92ae-d0b048573663 tempest-AttachVolumeTestJSON-490957537 None] Lock "cinder-2ad4acb4-c179-48f3-84ad-2a4b63bd1e5d-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:08 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=124,cinder:SELECT=106,cinder:INSERT=38,cinder:DELETE=4 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:05:08 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=117,cinder:INSERT=31,cinder:UPDATE=137,cinder:DELETE=6 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:10 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:10 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:10 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.308s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:05:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Flow 'volume_create_manager' (a0caf0bb-aab6-432e-9424-be079b596cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cca2f01-d62d-4cda-8912-a2fbeb8658ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cca2f01-d62d-4cda-8912-a2fbeb8658ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1787731530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cadce5-aa18-4c01-8d9c-fae97742af4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eddde0ac06ca412691ddb2301d226acb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:14Z,use_quota=True,user_id='534799d713174f6a8d2e41266a4ac779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5fd86f-94a7-4a8e-87c1-5c3f59014b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5fd86f-94a7-4a8e-87c1-5c3f59014b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf875a1-bbcc-4f16-8659-47841c3d2688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf875a1-bbcc-4f16-8659-47841c3d2688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6cadce5-aa18-4c01-8d9c-fae97742af4d', 'volume_name': 'volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4343a35-af7e-4b73-b725-4570128b1f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4343a35-af7e-4b73-b725-4570128b1f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25535d6-332b-4a67-b636-cb5254f5c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:14 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Volume c6cadce5-aa18-4c01-8d9c-fae97742af4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d', 'volume_size': 1} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1787731530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cadce5-aa18-4c01-8d9c-fae97742af4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eddde0ac06ca412691ddb2301d226acb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:14Z,use_quota=True,user_id='534799d713174f6a8d2e41266a4ac779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Creating volume c6cadce5-aa18-4c01-8d9c-fae97742af4d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:14 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:14 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d 1073741824 Aug 26 12:05:14 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:15 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d 1073741824" returned: 0 in 0.972s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:15 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d Aug 26 12:05:15 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Flow 'volume_create_manager' (a9a065b5-e46b-4a6e-804e-6e446a0ec5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a707769b-9f91-4222-b6a4-bfee50fafccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:15 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a707769b-9f91-4222-b6a4-bfee50fafccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2031919774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e71a21-a3c7-484c-8e5e-f8b339981630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2f39827e531428d9eed2ea1ba7eef1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:16Z,use_quota=True,user_id='77d91e6ad7f34c43b6d6ad1897799b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f388c0f-7387-47f0-97bd-147a9683f0af),volume_type_id=2f388c0f-7387-47f0-97bd-147a9683f0af)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857cf10-35f2-4141-a7c0-90cac7ba0b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857cf10-35f2-4141-a7c0-90cac7ba0b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4222b33-25d7-4293-b143-18a99be3487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4222b33-25d7-4293-b143-18a99be3487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e71a21-a3c7-484c-8e5e-f8b339981630', 'volume_name': 'volume-b4e71a21-a3c7-484c-8e5e-f8b339981630', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5510f80a-ab20-4665-9142-2460099a65df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5510f80a-ab20-4665-9142-2460099a65df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af821901-2fdf-48b9-afa2-ebd25e05ebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:15 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Volume b4e71a21-a3c7-484c-8e5e-f8b339981630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e71a21-a3c7-484c-8e5e-f8b339981630', 'volume_size': 1} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d" returned: 0 in 0.549s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2031919774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e71a21-a3c7-484c-8e5e-f8b339981630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2f39827e531428d9eed2ea1ba7eef1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:16Z,use_quota=True,user_id='77d91e6ad7f34c43b6d6ad1897799b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f388c0f-7387-47f0-97bd-147a9683f0af),volume_type_id=2f388c0f-7387-47f0-97bd-147a9683f0af)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Creating volume b4e71a21-a3c7-484c-8e5e-f8b339981630 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:16 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25535d6-332b-4a67-b636-cb5254f5c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e212ace-8d26-4ea9-8c34-25aefb7a9ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:16 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 1073741824 Aug 26 12:05:16 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:16 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Volume volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d (c6cadce5-aa18-4c01-8d9c-fae97742af4d): created successfully Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e212ace-8d26-4ea9-8c34-25aefb7a9ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Flow 'volume_create_manager' (a0caf0bb-aab6-432e-9424-be079b596cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-68e24137-8b2c-4582-85d8-054eeb5ae985 tempest-VolumesTestJSON-1659587769 None] Created volume successfully. Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:16 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Flow 'volume_create_manager' (6f3d749b-9d6b-4b9b-aaf9-c5d6f2a8133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ae475f-e429-41a2-bf0c-ca2bf1c27ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 1073741824" returned: 0 in 0.827s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ae475f-e429-41a2-bf0c-ca2bf1c27ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2139860961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a883705-e4ed-4098-9839-cc1c3ad89ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca27baefe66b4ac9a7a61e0e10a5d18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:17Z,use_quota=True,user_id='d261db2612304bb492291e8e17dc6af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b0c861-6bfc-4fc9-8852-616d99f165ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b0c861-6bfc-4fc9-8852-616d99f165ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7c97e1-57b3-4a3f-9b7c-d41a1ba0f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7c97e1-57b3-4a3f-9b7c-d41a1ba0f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a883705-e4ed-4098-9839-cc1c3ad89ff3', 'volume_name': 'volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178e8c51-bdb6-48ba-aab3-27a1077f36ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178e8c51-bdb6-48ba-aab3-27a1077f36ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adc75b1-b2c2-44b7-a4c3-83820fb1a199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:16 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Volume 3a883705-e4ed-4098-9839-cc1c3ad89ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3', 'volume_size': 1} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:16 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 Aug 26 12:05:16 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:17 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Flow 'volume_create_manager' (8e67e1af-89f0-471a-9dba-ec98bea5393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c186468-8c0e-42a3-b8cf-486f6a0a9efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630" returned: 0 in 0.292s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.336s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2139860961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a883705-e4ed-4098-9839-cc1c3ad89ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca27baefe66b4ac9a7a61e0e10a5d18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:17Z,use_quota=True,user_id='d261db2612304bb492291e8e17dc6af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Creating volume 3a883705-e4ed-4098-9839-cc1c3ad89ff3 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:17 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c186468-8c0e-42a3-b8cf-486f6a0a9efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2007235575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d454c713-cd18-4c68-89f8-6116f0071118,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eddde0ac06ca412691ddb2301d226acb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:17Z,use_quota=True,user_id='534799d713174f6a8d2e41266a4ac779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:17 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 1073741824 Aug 26 12:05:17 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40196d1-c3ae-4ce9-a1cd-d2cdfb376629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40196d1-c3ae-4ce9-a1cd-d2cdfb376629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f909ab8-de91-4148-8aff-68afd4136e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f909ab8-de91-4148-8aff-68afd4136e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd454c713-cd18-4c68-89f8-6116f0071118', 'volume_name': 'volume-d454c713-cd18-4c68-89f8-6116f0071118', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313225fe-5d75-4951-9ddb-93b19fcc9b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313225fe-5d75-4951-9ddb-93b19fcc9b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c51884-26b9-4205-b652-f5778cb1e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Volume d454c713-cd18-4c68-89f8-6116f0071118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d454c713-cd18-4c68-89f8-6116f0071118', 'volume_size': 1} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af821901-2fdf-48b9-afa2-ebd25e05ebcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e71a21-a3c7-484c-8e5e-f8b339981630', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25a6c9d-b604-457b-aa6c-07ed43b0aca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Volume volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 (b4e71a21-a3c7-484c-8e5e-f8b339981630): created successfully Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25a6c9d-b604-457b-aa6c-07ed43b0aca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Flow 'volume_create_manager' (a9a065b5-e46b-4a6e-804e-6e446a0ec5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:17 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3bc19d69-2845-4497-b61d-609b5049613d tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Created volume successfully. Aug 26 12:05:17 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 1073741824" returned: 0 in 0.595s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:17 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 Aug 26 12:05:17 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40cb242d-1d37-4737-b5ba-fe3ac57c5ba4 tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40cb242d-1d37-4737-b5ba-fe3ac57c5ba4 tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40cb242d-1d37-4737-b5ba-fe3ac57c5ba4 tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40cb242d-1d37-4737-b5ba-fe3ac57c5ba4 tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40cb242d-1d37-4737-b5ba-fe3ac57c5ba4 tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40cb242d-1d37-4737-b5ba-fe3ac57c5ba4 tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:18 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:18 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:18 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3" returned: 0 in 0.381s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2007235575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d454c713-cd18-4c68-89f8-6116f0071118,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eddde0ac06ca412691ddb2301d226acb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:17Z,use_quota=True,user_id='534799d713174f6a8d2e41266a4ac779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Creating volume d454c713-cd18-4c68-89f8-6116f0071118 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:18 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adc75b1-b2c2-44b7-a4c3-83820fb1a199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:18 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118 1073741824 Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c27fe4-5f33-4edf-8509-e5dfbf394ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:18 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:18 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Volume volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 (3a883705-e4ed-4098-9839-cc1c3ad89ff3): created successfully Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c27fe4-5f33-4edf-8509-e5dfbf394ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Flow 'volume_create_manager' (6f3d749b-9d6b-4b9b-aaf9-c5d6f2a8133d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:18 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0da4fd71-5b3e-49ab-9213-d00c9a05037d tempest-VolumeQuotasAdminTestJSON-1012377530 None] Created volume successfully. Aug 26 12:05:18 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40cb242d-1d37-4737-b5ba-fe3ac57c5ba4 tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.306s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-40cb242d-1d37-4737-b5ba-fe3ac57c5ba4 tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:18 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-40cb242d-1d37-4737-b5ba-fe3ac57c5ba4 tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Retype volume completed successfully. Aug 26 12:05:18 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118 1073741824" returned: 0 in 0.549s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:18 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118 Aug 26 12:05:18 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Acquiring lock "cinder-3a883705-e4ed-4098-9839-cc1c3ad89ff3-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "cinder-3a883705-e4ed-4098-9839-cc1c3ad89ff3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Acquiring lock "cinder-quobyte-3a883705-e4ed-4098-9839-cc1c3ad89ff3" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "cinder-quobyte-3a883705-e4ed-4098-9839-cc1c3ad89ff3" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1924d1-ecde-409a-a2b9-0d1d67c02793]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:19 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118" returned: 0 in 0.448s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c51884-26b9-4205-b652-f5778cb1e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d454c713-cd18-4c68-89f8-6116f0071118', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3d696f-f42a-4f24-b25a-0ad9257ac7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:19 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Volume volume-d454c713-cd18-4c68-89f8-6116f0071118 (d454c713-cd18-4c68-89f8-6116f0071118): created successfully Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3d696f-f42a-4f24-b25a-0ad9257ac7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Flow 'volume_create_manager' (8e67e1af-89f0-471a-9dba-ec98bea5393e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:19 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0d4d1bf9-c76d-4e75-9c4f-536ba4755437 tempest-VolumesTestJSON-1659587769 None] Created volume successfully. Aug 26 12:05:19 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 Aug 26 12:05:19 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Acquiring lock "cinder-b4e71a21-a3c7-484c-8e5e-f8b339981630-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "cinder-b4e71a21-a3c7-484c-8e5e-f8b339981630-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Acquiring lock "cinder-quobyte-b4e71a21-a3c7-484c-8e5e-f8b339981630" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "cinder-quobyte-b4e71a21-a3c7-484c-8e5e-f8b339981630" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba03d79-b1f2-4e6e-a08a-135ec8abc3f8]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:19 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3" returned: 0 in 0.656s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:19 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3 Aug 26 12:05:19 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:20 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 Aug 26 12:05:20 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:20 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a883705-e4ed-4098-9839-cc1c3ad89ff3" returned: 0 in 0.425s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "cinder-quobyte-3a883705-e4ed-4098-9839-cc1c3ad89ff3" released by "delete_volume" :: held 1.178s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:20 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630" returned: 0 in 0.533s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:20 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630 Aug 26 12:05:20 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Created reservations ['af758608-1146-4782-afce-858477965bed', 'f8fbd380-f798-4600-bfc4-655d0f632b15', '10a4db94-82c6-496d-948a-0dcbc3d0e4af', 'e030f67d-3128-4adb-9d83-9bfae9a71285'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:20 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:20 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:20 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b4e71a21-a3c7-484c-8e5e-f8b339981630" returned: 0 in 0.511s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "cinder-quobyte-b4e71a21-a3c7-484c-8e5e-f8b339981630" released by "delete_volume" :: held 1.154s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:21 devstack cinder-volume[94387]: WARNING cinder.quota [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:05:21 devstack cinder-volume[94387]: WARNING cinder.quota [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:05:21 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.471s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Created reservations ['84d80cb0-78d1-41ae-b6d8-ce2a074d6d68', '31c26133-09ca-4175-82f6-42f6fbaa925e', 'f7a45770-db70-47b6-83cf-80cb4e5354e1', '415f0bd5-7823-4f6e-9675-048f653f0acf'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Deleted volume successfully. Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8f4fa9b5-9fc4-4a81-86a7-4fea67539513 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "cinder-3a883705-e4ed-4098-9839-cc1c3ad89ff3-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:21 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:21 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Flow 'volume_create_manager' (2a54391f-9d79-473c-88f5-6276f5e90313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf780ff-e0fb-45c9-906d-9e135d2e4dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf780ff-e0fb-45c9-906d-9e135d2e4dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2105959575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2815805f-46e8-4243-8362-142b6c655c9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eddde0ac06ca412691ddb2301d226acb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:21Z,use_quota=True,user_id='534799d713174f6a8d2e41266a4ac779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1edc0e-aa76-44c6-914b-28435aa01c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1edc0e-aa76-44c6-914b-28435aa01c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d579fb12-1be4-4f2f-8d0e-9b663ddd341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d579fb12-1be4-4f2f-8d0e-9b663ddd341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2815805f-46e8-4243-8362-142b6c655c9a', 'volume_name': 'volume-2815805f-46e8-4243-8362-142b6c655c9a', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61bb949-1bc4-414f-bda8-d9e5a04fddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61bb949-1bc4-414f-bda8-d9e5a04fddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0fed9f-9f33-4fb3-ae4e-15bba5878136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:21 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Volume 2815805f-46e8-4243-8362-142b6c655c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2815805f-46e8-4243-8362-142b6c655c9a', 'volume_size': 1} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2105959575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2815805f-46e8-4243-8362-142b6c655c9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eddde0ac06ca412691ddb2301d226acb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:21Z,use_quota=True,user_id='534799d713174f6a8d2e41266a4ac779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Creating volume 2815805f-46e8-4243-8362-142b6c655c9a {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:21 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:21 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a 1073741824 Aug 26 12:05:21 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:21 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.425s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Deleted volume successfully. Aug 26 12:05:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-abf710e2-68f5-47d6-ae03-842d42a9a6bc tempest-VolumeRetypeWithoutMigrationTest-1912023351 None] Lock "cinder-b4e71a21-a3c7-484c-8e5e-f8b339981630-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Flow 'volume_create_manager' (ddc1a7af-89b8-4978-a988-eab63f5c1d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cb859e-1dca-42f7-8739-8487da8f8e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cb859e-1dca-42f7-8739-8487da8f8e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-529975392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149cad79-f224-48a9-b72b-ca23587f7718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca27baefe66b4ac9a7a61e0e10a5d18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:22Z,use_quota=True,user_id='d261db2612304bb492291e8e17dc6af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdbeea3-dfdb-4980-ac49-27bbaf595a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdbeea3-dfdb-4980-ac49-27bbaf595a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98397158-b89c-48d6-940e-ee79f2bbd4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98397158-b89c-48d6-940e-ee79f2bbd4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149cad79-f224-48a9-b72b-ca23587f7718', 'volume_name': 'volume-149cad79-f224-48a9-b72b-ca23587f7718', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82301fe0-65df-4e1a-a19e-3d1f04b7108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82301fe0-65df-4e1a-a19e-3d1f04b7108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7107c118-c4d4-4d44-9792-b7cb8c62f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:22 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Volume 149cad79-f224-48a9-b72b-ca23587f7718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149cad79-f224-48a9-b72b-ca23587f7718', 'volume_size': 1} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:22 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a 1073741824" returned: 0 in 1.103s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:22 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a Aug 26 12:05:22 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:23 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a" returned: 0 in 0.620s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.891s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-529975392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149cad79-f224-48a9-b72b-ca23587f7718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca27baefe66b4ac9a7a61e0e10a5d18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:22Z,use_quota=True,user_id='d261db2612304bb492291e8e17dc6af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Creating volume 149cad79-f224-48a9-b72b-ca23587f7718 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:23 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0fed9f-9f33-4fb3-ae4e-15bba5878136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2815805f-46e8-4243-8362-142b6c655c9a', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa0f54c-dc32-4e57-ae46-ca7a2a5428f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:23 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718 1073741824 Aug 26 12:05:23 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:23 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Volume volume-2815805f-46e8-4243-8362-142b6c655c9a (2815805f-46e8-4243-8362-142b6c655c9a): created successfully Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa0f54c-dc32-4e57-ae46-ca7a2a5428f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Flow 'volume_create_manager' (2a54391f-9d79-473c-88f5-6276f5e90313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-9d0d098e-82af-4119-8637-c0a0937f446b tempest-VolumesTestJSON-1659587769 None] Created volume successfully. Aug 26 12:05:24 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718 1073741824" returned: 0 in 0.924s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:24 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718 Aug 26 12:05:24 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:24 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718" returned: 0 in 0.376s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7107c118-c4d4-4d44-9792-b7cb8c62f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149cad79-f224-48a9-b72b-ca23587f7718', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b698b7a3-cd76-4e68-9276-36469a35b96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:24 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Volume volume-149cad79-f224-48a9-b72b-ca23587f7718 (149cad79-f224-48a9-b72b-ca23587f7718): created successfully Aug 26 12:05:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b698b7a3-cd76-4e68-9276-36469a35b96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Flow 'volume_create_manager' (ddc1a7af-89b8-4978-a988-eab63f5c1d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-49f7480c-17d6-4c5c-9dfc-6bf9fc3e2040 tempest-VolumeQuotasAdminTestJSON-1012377530 None] Created volume successfully. Aug 26 12:05:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Acquiring lock "cinder-2815805f-46e8-4243-8362-142b6c655c9a-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Lock "cinder-2815805f-46e8-4243-8362-142b6c655c9a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Acquiring lock "cinder-quobyte-2815805f-46e8-4243-8362-142b6c655c9a" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Lock "cinder-quobyte-2815805f-46e8-4243-8362-142b6c655c9a" acquired by "delete_volume" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f288b9c-c946-40e0-a3a6-257a2ffd34ac]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:26 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a Aug 26 12:05:26 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:26 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a" returned: 0 in 0.669s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:26 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a Aug 26 12:05:26 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:27 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2815805f-46e8-4243-8362-142b6c655c9a" returned: 0 in 0.492s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Lock "cinder-quobyte-2815805f-46e8-4243-8362-142b6c655c9a" released by "delete_volume" :: held 1.298s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:27 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Created reservations ['68e49aed-b255-4d21-ac2b-5f0c33e28a75', '83b23bc9-1123-487c-999e-481a415f9975', '9e29642a-56d3-4334-9db1-08f05276cd12', 'd57ea9ed-f6f3-484e-9416-c5d725530e6d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b15003da-29bc-41fc-9b1d-101cf8e5c39c tempest-VolumeQuotasAdminTestJSON-888366820 None] Transfer volume completed successfully. Aug 26 12:05:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.106s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:27 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:27 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Acquiring lock "cinder-d454c713-cd18-4c68-89f8-6116f0071118-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Lock "cinder-d454c713-cd18-4c68-89f8-6116f0071118-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Acquiring lock "cinder-quobyte-d454c713-cd18-4c68-89f8-6116f0071118" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Lock "cinder-quobyte-d454c713-cd18-4c68-89f8-6116f0071118" acquired by "delete_volume" :: waited 0.036s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:28 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.996s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2badaa7-b5de-4da8-bef3-073d42bdcb47]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Deleted volume successfully. Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Acquiring lock "cinder-149cad79-f224-48a9-b72b-ca23587f7718-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Lock "cinder-149cad79-f224-48a9-b72b-ca23587f7718-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d301562f-05ac-4296-9001-a42d4b68165c tempest-VolumesTestJSON-1659587769 None] Lock "cinder-2815805f-46e8-4243-8362-142b6c655c9a-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Acquiring lock "cinder-quobyte-149cad79-f224-48a9-b72b-ca23587f7718" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Lock "cinder-quobyte-149cad79-f224-48a9-b72b-ca23587f7718" acquired by "delete_volume" :: waited 0.048s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:29 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[513eb80a-54da-451f-a8ed-726de335f425]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:29 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118 Aug 26 12:05:29 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:29 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718 Aug 26 12:05:29 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:29 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718" returned: 0 in 0.686s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:29 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718 Aug 26 12:05:29 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:29 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118" returned: 0 in 1.192s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:29 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118 Aug 26 12:05:29 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:30 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-149cad79-f224-48a9-b72b-ca23587f7718" returned: 0 in 0.581s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Lock "cinder-quobyte-149cad79-f224-48a9-b72b-ca23587f7718" released by "delete_volume" :: held 1.375s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:30 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d454c713-cd18-4c68-89f8-6116f0071118" returned: 0 in 0.548s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Lock "cinder-quobyte-d454c713-cd18-4c68-89f8-6116f0071118" released by "delete_volume" :: held 1.853s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Created reservations ['5e1b19e3-28fd-473a-8337-c16bacab849e', 'bbdad752-f21e-4261-993c-f8665a063964', '80cc0ebb-6c62-4a0e-b792-89c0c918edc2', '9a1bfc46-d7ee-4dcc-9fa2-103ab770ca04'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Created reservations ['73221887-9cbe-4dce-b7bc-ef1bd000d2b3', 'dfec5f65-4bbf-4e89-93c5-8717ab8544c9', '85f8c44f-9595-4d8e-ae64-0ffc8238f89a', '57f931de-6d38-4275-b033-6d708dc3cb46'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:30 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:30 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:30 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:30 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Acquiring lock "cinder-c6cadce5-aa18-4c01-8d9c-fae97742af4d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Lock "cinder-c6cadce5-aa18-4c01-8d9c-fae97742af4d-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Acquiring lock "cinder-quobyte-c6cadce5-aa18-4c01-8d9c-fae97742af4d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Lock "cinder-quobyte-c6cadce5-aa18-4c01-8d9c-fae97742af4d" acquired by "delete_volume" :: waited 0.052s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:31 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.569s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:31 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Deleted volume successfully. Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7699b4a9-6b96-49c2-b464-1e4ec772729d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b30d2734-cac6-4cd7-9b74-85cafd913f80 tempest-VolumeQuotasAdminTestJSON-1412685278 None] Lock "cinder-149cad79-f224-48a9-b72b-ca23587f7718-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:31 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.716s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:31 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Deleted volume successfully. Aug 26 12:05:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-16cadd9f-d7fb-4d86-a532-d033cb8bc128 tempest-VolumesTestJSON-1659587769 None] Lock "cinder-d454c713-cd18-4c68-89f8-6116f0071118-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:31 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d Aug 26 12:05:31 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:32 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d" returned: 0 in 0.870s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:32 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d Aug 26 12:05:32 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:32 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c6cadce5-aa18-4c01-8d9c-fae97742af4d" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Lock "cinder-quobyte-c6cadce5-aa18-4c01-8d9c-fae97742af4d" released by "delete_volume" :: held 1.325s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Created reservations ['c1a218eb-00b3-4fda-9b6d-8dd9414bf62e', '448d987a-5891-466e-9bf0-947cae96660a', '864c0ad3-6c1a-48b5-a61f-dcbfb54462ac', '257ae461-1c8d-4bf9-afb4-ce3438d7a68d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:32 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:32 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:33 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.354s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:33 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:33 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Deleted volume successfully. Aug 26 12:05:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e99ce7c6-bde8-4f68-a289-7c516105aaac tempest-VolumesTestJSON-1659587769 None] Lock "cinder-c6cadce5-aa18-4c01-8d9c-fae97742af4d-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Flow 'volume_create_manager' (53200e41-51c9-4282-a60d-0f587ea2b5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08858b47-2885-402d-b8a2-c3481cf4725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08858b47-2885-402d-b8a2-c3481cf4725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1904270296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ee5d5d-1e40-4046-934e-0bfd40d11fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44987c5eb964ceb85152f978baa5c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:35Z,use_quota=True,user_id='1f1b73e2383c4d7083c0384990e2231d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da04dd4-c031-4c9f-a6e6-341968edf22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da04dd4-c031-4c9f-a6e6-341968edf22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8befd48d-b48d-47b8-bd5f-8ec5c708808a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8befd48d-b48d-47b8-bd5f-8ec5c708808a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ee5d5d-1e40-4046-934e-0bfd40d11fd2', 'volume_name': 'volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ceb05db-66c3-4cda-814d-2009c7a44b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ceb05db-66c3-4cda-814d-2009c7a44b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c9b0a6-6258-4b3d-bbcc-536ce22531d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:35 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Volume 04ee5d5d-1e40-4046-934e-0bfd40d11fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2', 'volume_size': 1} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1904270296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ee5d5d-1e40-4046-934e-0bfd40d11fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44987c5eb964ceb85152f978baa5c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:35Z,use_quota=True,user_id='1f1b73e2383c4d7083c0384990e2231d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Creating volume 04ee5d5d-1e40-4046-934e-0bfd40d11fd2 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:35 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:35 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 1073741824 Aug 26 12:05:35 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:35 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 1073741824" returned: 0 in 0.531s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:35 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 Aug 26 12:05:35 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:36 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2" returned: 0 in 0.406s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c9b0a6-6258-4b3d-bbcc-536ce22531d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8d0c4e-33b3-485a-b7f0-d7f5e9cdbe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Volume volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 (04ee5d5d-1e40-4046-934e-0bfd40d11fd2): created successfully Aug 26 12:05:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8d0c4e-33b3-485a-b7f0-d7f5e9cdbe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Flow 'volume_create_manager' (53200e41-51c9-4282-a60d-0f587ea2b5dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-aff40b3f-edb1-4e0e-bb7f-349aa03a8fbb tempest-VolumesServicesTestJSON-103070381 None] Created volume successfully. Aug 26 12:05:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Acquiring lock "cinder-04ee5d5d-1e40-4046-934e-0bfd40d11fd2-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Lock "cinder-04ee5d5d-1e40-4046-934e-0bfd40d11fd2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Acquiring lock "cinder-quobyte-04ee5d5d-1e40-4046-934e-0bfd40d11fd2" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Lock "cinder-quobyte-04ee5d5d-1e40-4046-934e-0bfd40d11fd2" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:37 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ccd624-5482-4f76-8a95-a6140a309156]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:37 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 Aug 26 12:05:37 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:38 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2" returned: 0 in 0.536s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:38 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2 Aug 26 12:05:38 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Flow 'volume_create_manager' (4590eb86-19f9-4863-a37a-4fff970243a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b4d38b-d713-40f7-8ccd-c8c97bf33566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b4d38b-d713-40f7-8ccd-c8c97bf33566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-650094243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1010143c-877f-4b88-a401-4b4a3c1fd620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750c8b4280e945749aa46a08c379ebcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:38Z,use_quota=True,user_id='3d9ef38b404c45dd93bd7f3b3c7f8bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab55e158-adff-4580-8079-aef646aaa65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab55e158-adff-4580-8079-aef646aaa65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb671c6-7353-4895-afc8-a831caaa44df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb671c6-7353-4895-afc8-a831caaa44df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1010143c-877f-4b88-a401-4b4a3c1fd620', 'volume_name': 'volume-1010143c-877f-4b88-a401-4b4a3c1fd620', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de083db2-70af-4efb-9d95-93e1598678f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de083db2-70af-4efb-9d95-93e1598678f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a21e91-7b23-4054-8da8-9b1bbdc107b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:38 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Volume 1010143c-877f-4b88-a401-4b4a3c1fd620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1010143c-877f-4b88-a401-4b4a3c1fd620', 'volume_size': 1} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-650094243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1010143c-877f-4b88-a401-4b4a3c1fd620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750c8b4280e945749aa46a08c379ebcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:38Z,use_quota=True,user_id='3d9ef38b404c45dd93bd7f3b3c7f8bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Creating volume 1010143c-877f-4b88-a401-4b4a3c1fd620 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:38 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:38 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620 1073741824 Aug 26 12:05:38 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:38 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-04ee5d5d-1e40-4046-934e-0bfd40d11fd2" returned: 0 in 0.430s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Lock "cinder-quobyte-04ee5d5d-1e40-4046-934e-0bfd40d11fd2" released by "delete_volume" :: held 1.048s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Created reservations ['15241154-3a8a-4f93-a904-9bece7363f16', '3d541b1d-c430-45aa-a877-4bc1415eb842', '4c06835a-ae34-4f04-9acd-a2138941f717', '4a37d7c4-2797-46be-b226-07261ab5b680'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:38 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:38 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:39 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620 1073741824" returned: 0 in 0.563s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:39 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620 Aug 26 12:05:39 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:39 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.408s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Deleted volume successfully. Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7da9714-b99c-49a4-9ce1-9b1ff8c8af45 tempest-VolumesServicesTestJSON-103070381 None] Lock "cinder-04ee5d5d-1e40-4046-934e-0bfd40d11fd2-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:39 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620" returned: 0 in 0.322s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a21e91-7b23-4054-8da8-9b1bbdc107b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1010143c-877f-4b88-a401-4b4a3c1fd620', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7c41b3-0559-46ef-ad35-e55aab62a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:39 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Volume volume-1010143c-877f-4b88-a401-4b4a3c1fd620 (1010143c-877f-4b88-a401-4b4a3c1fd620): created successfully Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7c41b3-0559-46ef-ad35-e55aab62a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Flow 'volume_create_manager' (4590eb86-19f9-4863-a37a-4fff970243a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-832b531c-7fba-4093-9268-7608ca56a43e tempest-ServersNegativeTestJSON-239929963 None] Created volume successfully. Aug 26 12:05:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8de0a578-61d7-4585-9e4a-1d60abd9a4cb tempest-GroupsV314Test-1495416298 None] Group tempest-GroupsV314Test-Group-223477209: creating Aug 26 12:05:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8de0a578-61d7-4585-9e4a-1d60abd9a4cb tempest-GroupsV314Test-1495416298 None] Group tempest-GroupsV314Test-Group-223477209: created successfully Aug 26 12:05:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8de0a578-61d7-4585-9e4a-1d60abd9a4cb tempest-GroupsV314Test-1495416298 None] Create group completed successfully. Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Flow 'volume_create_manager' (fa8a434a-90b2-4fd9-a36b-6f7dff3259b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412e7bb9-fe82-4142-8b06-85717a1ce0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412e7bb9-fe82-4142-8b06-85717a1ce0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2022934762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2d81f5c-5d35-4747-9f8f-382b30713c01,host='devstack@QuobyteHD#QuobyteHD',id=138864f3-8f43-4d03-bab9-055bd11f249e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1496cc9e0a64486845b90d7ae947208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:42Z,use_quota=True,user_id='76bb7819985f4583beeba69a597d14a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28de904a-9432-4cd3-8760-56f118247eba),volume_type_id=28de904a-9432-4cd3-8760-56f118247eba)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e06daa2-3d8a-4c80-a689-7bf86f41113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e06daa2-3d8a-4c80-a689-7bf86f41113b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15286ce9-7bca-4c77-b6c4-c1dd461eb3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15286ce9-7bca-4c77-b6c4-c1dd461eb3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138864f3-8f43-4d03-bab9-055bd11f249e', 'volume_name': 'volume-138864f3-8f43-4d03-bab9-055bd11f249e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60de0dd6-2d70-4a2c-b1dd-d5e7590999c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60de0dd6-2d70-4a2c-b1dd-d5e7590999c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a102db13-5b79-49b6-b253-78ed8462f0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Volume 138864f3-8f43-4d03-bab9-055bd11f249e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138864f3-8f43-4d03-bab9-055bd11f249e', 'volume_size': 1} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e2d81f5c-5d35-4747-9f8f-382b30713c01,created_at=2026-08-26T10:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2022934762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2d81f5c-5d35-4747-9f8f-382b30713c01,host='devstack@QuobyteHD#QuobyteHD',id=138864f3-8f43-4d03-bab9-055bd11f249e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1496cc9e0a64486845b90d7ae947208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:42Z,use_quota=True,user_id='76bb7819985f4583beeba69a597d14a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28de904a-9432-4cd3-8760-56f118247eba),volume_type_id=28de904a-9432-4cd3-8760-56f118247eba)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Creating volume 138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:42 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:42 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e 1073741824 Aug 26 12:05:42 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Flow 'volume_create_manager' (9fcc8861-17ff-4bf9-9b77-5726b543fca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd433fbc-6ab5-46d8-be8d-2bb4d61eede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd433fbc-6ab5-46d8-be8d-2bb4d61eede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1376713467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0757077c-4fe6-4721-8510-b3f886329334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750c8b4280e945749aa46a08c379ebcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:43Z,use_quota=True,user_id='3d9ef38b404c45dd93bd7f3b3c7f8bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5bcf8f-0e38-4a2a-b708-0649810ccd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5bcf8f-0e38-4a2a-b708-0649810ccd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2aef6ed-bac1-443e-8ca5-2eb62d49b376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2aef6ed-bac1-443e-8ca5-2eb62d49b376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0757077c-4fe6-4721-8510-b3f886329334', 'volume_name': 'volume-0757077c-4fe6-4721-8510-b3f886329334', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4bea18-15b8-43bc-82d2-8a5b936821de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4bea18-15b8-43bc-82d2-8a5b936821de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e876b9a-dfeb-4b08-be53-add516c232f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:42 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Volume 0757077c-4fe6-4721-8510-b3f886329334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0757077c-4fe6-4721-8510-b3f886329334', 'volume_size': 1} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:42 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e 1073741824" returned: 0 in 0.664s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:42 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e Aug 26 12:05:42 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:43 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1376713467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0757077c-4fe6-4721-8510-b3f886329334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750c8b4280e945749aa46a08c379ebcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:43Z,use_quota=True,user_id='3d9ef38b404c45dd93bd7f3b3c7f8bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Creating volume 0757077c-4fe6-4721-8510-b3f886329334 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:43 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a102db13-5b79-49b6-b253-78ed8462f0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138864f3-8f43-4d03-bab9-055bd11f249e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7582298-ac8a-40f3-81ee-076a1f2e2f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:43 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334 1073741824 Aug 26 12:05:43 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Volume volume-138864f3-8f43-4d03-bab9-055bd11f249e (138864f3-8f43-4d03-bab9-055bd11f249e): created successfully Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7582298-ac8a-40f3-81ee-076a1f2e2f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Flow 'volume_create_manager' (fa8a434a-90b2-4fd9-a36b-6f7dff3259b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b91365e2-8e77-4a56-b238-a0569060d7b3 tempest-GroupsV314Test-1495416298 None] Created volume successfully. Aug 26 12:05:43 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334 1073741824" returned: 0 in 0.692s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:44 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334 Aug 26 12:05:44 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:44 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334" returned: 0 in 0.399s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.102s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:44 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Cloning volume 138864f3-8f43-4d03-bab9-055bd11f249e to volume 4215a437-a0ac-49a8-a2d7-ef08a4c8a528 Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e876b9a-dfeb-4b08-be53-add516c232f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0757077c-4fe6-4721-8510-b3f886329334', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0459368f-fb7b-4bf1-8a84-82724f36e49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:44 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Volume volume-0757077c-4fe6-4721-8510-b3f886329334 (0757077c-4fe6-4721-8510-b3f886329334): created successfully Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0459368f-fb7b-4bf1-8a84-82724f36e49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Flow 'volume_create_manager' (9fcc8861-17ff-4bf9-9b77-5726b543fca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ad0ffe83-6815-4181-9b47-d72bfd45930c tempest-ServersNegativeTestJSON-239929963 None] Created volume successfully. Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Creating offline snapshot c6a55b06-9b95-4923-85ff-835aec58fc57 of volume 138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3acd8d-fa14-4f00-8c09-170118954607]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:44 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e Aug 26 12:05:44 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:45 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e" returned: 0 in 0.633s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:45 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 1G Aug 26 12:05:45 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "cinder-0757077c-4fe6-4721-8510-b3f886329334-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Lock "cinder-0757077c-4fe6-4721-8510-b3f886329334-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "cinder-quobyte-0757077c-4fe6-4721-8510-b3f886329334" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Lock "cinder-quobyte-0757077c-4fe6-4721-8510-b3f886329334" acquired by "delete_volume" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a31c1b-6fdb-483f-b6b4-2f54dc9b32c4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:45 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334 Aug 26 12:05:45 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:45 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 1G" returned: 0 in 0.641s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-138864f3-8f43-4d03-bab9-055bd11f249e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:45 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-138864f3-8f43-4d03-bab9-055bd11f249e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 Aug 26 12:05:45 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:45 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334" returned: 0 in 0.422s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:46 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334 Aug 26 12:05:46 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:46 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-138864f3-8f43-4d03-bab9-055bd11f249e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57" returned: 0 in 0.427s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:46 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:46 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 Aug 26 12:05:46 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:46 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0757077c-4fe6-4721-8510-b3f886329334" returned: 0 in 0.412s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Lock "cinder-quobyte-0757077c-4fe6-4721-8510-b3f886329334" released by "delete_volume" :: held 0.900s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Created reservations ['c28a3836-4789-4e3c-972b-560ebfe0ff73', 'df13f53d-1705-43e6-a6c4-83d08b2d6316', '827f0ce1-6aa3-448d-a37e-349ac921de10', 'bcc84790-15bb-4e01-b388-0fcee5ab2ca7'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:46 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57" returned: 0 in 0.370s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:46 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:46 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:46 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.info Aug 26 12:05:46 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:46 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:46 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Deleted volume successfully. Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-bd83a206-9a7f-49b7-a870-a087930f0ffa tempest-ServersNegativeTestJSON-239929963 None] Lock "cinder-0757077c-4fe6-4721-8510-b3f886329334-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:47 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.info" returned: 0 in 0.406s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:47 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:47 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.info Aug 26 12:05:47 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:47 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.info" returned: 0 in 0.267s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Acquiring lock "cinder-quobyte-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Lock "cinder-quobyte-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] snapshot: c6a55b06-9b95-4923-85ff-835aec58fc57, volume: 4215a437-a0ac-49a8-a2d7-ef08a4c8a528, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1441ba41-e1d0-4f47-b447-645f5768b58f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:47 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 Aug 26 12:05:47 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "cinder-1010143c-877f-4b88-a401-4b4a3c1fd620-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Lock "cinder-1010143c-877f-4b88-a401-4b4a3c1fd620-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Flow 'volume_create_manager' (fad7b2e3-265e-43cf-a95b-215e150596db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec17f98a-a0e3-4fd6-84f9-fb1c731cb777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "cinder-quobyte-1010143c-877f-4b88-a401-4b4a3c1fd620" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec17f98a-a0e3-4fd6-84f9-fb1c731cb777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-934133115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be60ab1a-6d15-4114-8e4f-eb4336eb0036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ccd25ae0aa4a089ff1761bdf265070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:48Z,use_quota=True,user_id='c8e54418352344ad882f31a3dc757d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4e7964-7eca-4037-86df-8e533214a598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4e7964-7eca-4037-86df-8e533214a598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8b3163-637c-428b-9309-6fb7115e4f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8b3163-637c-428b-9309-6fb7115e4f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be60ab1a-6d15-4114-8e4f-eb4336eb0036', 'volume_name': 'volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf00afb-95c0-4ec8-9dc0-356c607590ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf00afb-95c0-4ec8-9dc0-356c607590ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2304203a-d4d4-4899-baf3-e0f0bffbc797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:47 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Volume be60ab1a-6d15-4114-8e4f-eb4336eb0036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036', 'volume_size': 1} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Lock "cinder-quobyte-1010143c-877f-4b88-a401-4b4a3c1fd620" acquired by "delete_volume" :: waited 0.077s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:47 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57" returned: 0 in 0.525s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-138864f3-8f43-4d03-bab9-055bd11f249e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba504ac8-38fd-4e03-bdfd-2a4cef9c5f68]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60108e-507a-4079-bdec-8357732828d2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:48 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620 Aug 26 12:05:48 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:48 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e Aug 26 12:05:48 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:48 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e" returned: 0 in 0.388s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:48 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620" returned: 0 in 0.423s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:48 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 Aug 26 12:05:48 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:48 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620 Aug 26 12:05:48 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:48 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1010143c-877f-4b88-a401-4b4a3c1fd620" returned: 0 in 0.293s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Lock "cinder-quobyte-1010143c-877f-4b88-a401-4b4a3c1fd620" released by "delete_volume" :: held 0.777s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Created reservations ['c1b5305a-c8a6-4b31-81b5-f82eb4f81275', '01020ab2-63fd-4ec7-a2f9-280aae8b919e', '35cd13bb-dd55-4977-b1db-57f4dfd784cd', '392ec287-d3c9-4de8-8858-7154d4dd24be'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:48 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:05:48 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:49 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.847s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:49 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:05:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Deleted volume successfully. Aug 26 12:05:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c74c85d0-e6f3-45e6-b435-ec1ad71fba59 tempest-ServersNegativeTestJSON-239929963 None] Lock "cinder-1010143c-877f-4b88-a401-4b4a3c1fd620-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Flow 'volume_create_manager' (bb37e5e4-fcff-4750-968b-19515d1e92df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9cf620-bf18-43e6-9ab9-ff36d2f0b3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9cf620-bf18-43e6-9ab9-ff36d2f0b3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-561533430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46919a9e-8aec-4932-9c37-75ba309cacd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c293f97314874bc0b266c7961343d4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:53Z,use_quota=True,user_id='576a8fc74da14e61a7d802b2b4b281af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2233b7d1-c7c4-4479-aca4-e605ec32f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2233b7d1-c7c4-4479-aca4-e605ec32f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9f8d75-73e7-4378-818b-bc82fae8d2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9f8d75-73e7-4378-818b-bc82fae8d2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46919a9e-8aec-4932-9c37-75ba309cacd7', 'volume_name': 'volume-46919a9e-8aec-4932-9c37-75ba309cacd7', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60375d17-3cfc-465b-9b3c-82b2447f446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60375d17-3cfc-465b-9b3c-82b2447f446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8651efdb-15dc-4e89-a77b-dbe25868c87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:53 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Volume 46919a9e-8aec-4932-9c37-75ba309cacd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46919a9e-8aec-4932-9c37-75ba309cacd7', 'volume_size': 1} Aug 26 12:05:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:54 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" returned: 0 in 6.558s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:54 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:05:54 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Converted 1024.00 MB image at 156.14 MB/s Aug 26 12:05:54 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 12:05:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:54 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 Aug 26 12:05:54 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:55 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" returned: 0 in 0.229s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Lock "cinder-quobyte-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" released by "_copy_volume_from_snapshot" :: held 7.795s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Acquiring lock "cinder-quobyte-c6a55b06-9b95-4923-85ff-835aec58fc57" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Lock "cinder-quobyte-c6a55b06-9b95-4923-85ff-835aec58fc57" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Deleting offline snapshot c6a55b06-9b95-4923-85ff-835aec58fc57 of volume 138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] snapshot_file for this snap is: volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[da53725b-b651-43e7-906b-de5baf68a8cd]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:55 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 Aug 26 12:05:55 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:55 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57" returned: 0 in 0.370s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-138864f3-8f43-4d03-bab9-055bd11f249e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a304254-12a6-4f68-9ccb-a5c02a56fa3f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:55 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e Aug 26 12:05:55 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:56 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e" returned: 0 in 0.552s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:56 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 Aug 26 12:05:56 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:56 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57" returned: 0 in 0.377s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:56 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57 Aug 26 12:05:56 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:56 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e.c6a55b06-9b95-4923-85ff-835aec58fc57" returned: 0 in 0.239s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Lock "cinder-quobyte-c6a55b06-9b95-4923-85ff-835aec58fc57" released by "_delete_snapshot" :: held 1.656s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.516s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.981s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-934133115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be60ab1a-6d15-4114-8e4f-eb4336eb0036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ccd25ae0aa4a089ff1761bdf265070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:48Z,use_quota=True,user_id='c8e54418352344ad882f31a3dc757d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Creating volume be60ab1a-6d15-4114-8e4f-eb4336eb0036 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:56 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:56 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 1073741824 Aug 26 12:05:56 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:57 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-66a06975-0c9b-441a-ad92-d3285baba539 tempest-GroupsV314Test-1495416298 None] Create group from source-group-e2d81f5c-5d35-4747-9f8f-382b30713c01 completed successfully. Aug 26 12:05:57 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 1073741824" returned: 0 in 0.448s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:57 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 Aug 26 12:05:57 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:57 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036" returned: 0 in 0.282s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.224s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-561533430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46919a9e-8aec-4932-9c37-75ba309cacd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c293f97314874bc0b266c7961343d4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:05:53Z,use_quota=True,user_id='576a8fc74da14e61a7d802b2b4b281af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Creating volume 46919a9e-8aec-4932-9c37-75ba309cacd7 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:05:57 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:57 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7 1073741824 Aug 26 12:05:57 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2304203a-d4d4-4899-baf3-e0f0bffbc797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257992bc-843b-41a7-8d7b-6918d57c7453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:57 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Volume volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 (be60ab1a-6d15-4114-8e4f-eb4336eb0036): created successfully Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257992bc-843b-41a7-8d7b-6918d57c7453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Flow 'volume_create_manager' (fad7b2e3-265e-43cf-a95b-215e150596db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:57 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-97e7bc0b-7572-4ad0-a332-2273e01d0bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Created volume successfully. Aug 26 12:05:58 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7 1073741824" returned: 0 in 0.481s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:58 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7 Aug 26 12:05:58 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:05:58 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7" returned: 0 in 0.304s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.171s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8651efdb-15dc-4e89-a77b-dbe25868c87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46919a9e-8aec-4932-9c37-75ba309cacd7', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ec8633-1839-477d-8c68-5eb40a390bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Creating offline snapshot 472988be-0109-4011-8cc4-eda9427ed387 of volume be60ab1a-6d15-4114-8e4f-eb4336eb0036 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:05:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Volume volume-46919a9e-8aec-4932-9c37-75ba309cacd7 (46919a9e-8aec-4932-9c37-75ba309cacd7): created successfully Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ec8633-1839-477d-8c68-5eb40a390bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Flow 'volume_create_manager' (bb37e5e4-fcff-4750-968b-19515d1e92df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bdb14d-7fd4-46fa-b391-b1e6f57aba0a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-710a9038-9dd2-492e-9b46-2bbae641c178 tempest-VolumesListAdminTestJSON-280938076 None] Created volume successfully. Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Acquiring lock "cinder-quobyte-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Lock "cinder-quobyte-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:05:58 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 Aug 26 12:05:58 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[776ce2f5-85e4-4dac-b8ed-322e0c6ad32f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:05:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:58 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 Aug 26 12:05:58 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:59 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036" returned: 0 in 0.464s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:59 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 1G Aug 26 12:05:59 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:59 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" returned: 0 in 0.449s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:59 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528 Aug 26 12:05:59 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:59 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" returned: 0 in 0.325s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Lock "cinder-quobyte-4215a437-a0ac-49a8-a2d7-ef08a4c8a528" released by "delete_volume" :: held 0.834s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:05:59 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 1G" returned: 0 in 0.601s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:05:59 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 Aug 26 12:05:59 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Created reservations ['9a04a65c-ad7c-4961-bef9-848bb555b7e4'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:05:59 devstack cinder-volume[94387]: WARNING cinder.quota [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-54000431 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-54000431, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:05:59 devstack cinder-volume[94387]: WARNING cinder.quota [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-54000431 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-54000431, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:05:59 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Created reservations ['8f4d86dc-3a75-4dd5-8032-e6cdbd7f37b6', '3fc8a2e0-6ead-4c17-be72-18b943fe9902', '802436ce-6195-4c38-a92b-6436bb78cab8', '3aded692-b7f5-433e-a8b9-c80e81378156'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:00 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:00 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:00 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387" returned: 0 in 0.523s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:00 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 is being set with open permissions: ugo+rw Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:00 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 Aug 26 12:06:00 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Flow 'volume_create_manager' (b0e4a15e-fc90-43e4-b9c1-921c0a6f3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b998ee-cd75-4f77-953d-58ac047c6d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b998ee-cd75-4f77-953d-58ac047c6d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1811855009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59665cf-93d6-4700-b1c7-258158e55f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c293f97314874bc0b266c7961343d4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:00Z,use_quota=True,user_id='576a8fc74da14e61a7d802b2b4b281af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba693057-3a42-4a93-a8bc-46a28a3aaf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba693057-3a42-4a93-a8bc-46a28a3aaf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca541661-dc9b-48f6-8c9d-22f8ed5dc34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca541661-dc9b-48f6-8c9d-22f8ed5dc34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59665cf-93d6-4700-b1c7-258158e55f6d', 'volume_name': 'volume-c59665cf-93d6-4700-b1c7-258158e55f6d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd682d9-ccb0-4b0d-bf0f-4bae56f09cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd682d9-ccb0-4b0d-bf0f-4bae56f09cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5d4d65-7e28-4226-a6b5-3faa4f6056a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:00 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Volume c59665cf-93d6-4700-b1c7-258158e55f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59665cf-93d6-4700-b1c7-258158e55f6d', 'volume_size': 1} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:00 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.343s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8fbb5365-3f93-4ab6-9a0e-23e6c644077f tempest-GroupsV314Test-1495416298 None] Delete group completed successfully. Aug 26 12:06:00 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387" returned: 0 in 0.285s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:00 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.info Aug 26 12:06:00 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:00 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.info" returned: 0 in 0.299s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:00 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.info is being set with open permissions: ugo+rw Aug 26 12:06:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:00 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.info Aug 26 12:06:00 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:01 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.info" returned: 0 in 0.278s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.830s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1811855009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59665cf-93d6-4700-b1c7-258158e55f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c293f97314874bc0b266c7961343d4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:00Z,use_quota=True,user_id='576a8fc74da14e61a7d802b2b4b281af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Creating volume c59665cf-93d6-4700-b1c7-258158e55f6d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:01 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:01 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d 1073741824 Aug 26 12:06:01 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:01 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e11dc9cd-8c44-491d-9caa-ab697bc9a9be tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Create snapshot completed successfully Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Acquiring lock "cinder-quobyte-138864f3-8f43-4d03-bab9-055bd11f249e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Lock "cinder-quobyte-138864f3-8f43-4d03-bab9-055bd11f249e" acquired by "delete_volume" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d936e1-4363-4a71-abe9-99e69b31d7f1]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:01 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e Aug 26 12:06:01 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:01 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d 1073741824" returned: 0 in 0.583s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:01 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d Aug 26 12:06:01 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:01 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e" returned: 0 in 0.448s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:02 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e Aug 26 12:06:02 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Acquiring lock "cinder-472988be-0109-4011-8cc4-eda9427ed387-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-472988be-0109-4011-8cc4-eda9427ed387-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Acquiring lock "cinder-quobyte-be60ab1a-6d15-4114-8e4f-eb4336eb0036" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-quobyte-be60ab1a-6d15-4114-8e4f-eb4336eb0036" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Acquiring lock "cinder-quobyte-472988be-0109-4011-8cc4-eda9427ed387" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-quobyte-472988be-0109-4011-8cc4-eda9427ed387" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Deleting offline snapshot 472988be-0109-4011-8cc4-eda9427ed387 of volume be60ab1a-6d15-4114-8e4f-eb4336eb0036 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:06:02 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] snapshot_file for this snap is: volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d" returned: 0 in 0.387s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fc64de-8a28-4d98-ba28-0a82a6685114]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:02 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5d4d65-7e28-4226-a6b5-3faa4f6056a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59665cf-93d6-4700-b1c7-258158e55f6d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f77245f-073f-4815-8a22-62b4fed9077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-138864f3-8f43-4d03-bab9-055bd11f249e" returned: 0 in 0.319s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Lock "cinder-quobyte-138864f3-8f43-4d03-bab9-055bd11f249e" released by "delete_volume" :: held 0.850s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:02 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Volume volume-c59665cf-93d6-4700-b1c7-258158e55f6d (c59665cf-93d6-4700-b1c7-258158e55f6d): created successfully Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f77245f-073f-4815-8a22-62b4fed9077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Flow 'volume_create_manager' (b0e4a15e-fc90-43e4-b9c1-921c0a6f3493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ca6f6e1b-719f-4233-b557-13f87e9faa2d tempest-VolumesListAdminTestJSON-280938076 None] Created volume successfully. Aug 26 12:06:02 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 Aug 26 12:06:02 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Created reservations ['18391c61-0d5f-4548-b5d3-b3a2f2a0a4d5'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Created reservations ['382e590d-a5c4-4aed-991f-ee06e4e204d2', '11ecf42b-e2d6-43f1-aa0b-1b3477445b63', '0e3d7185-d395-4e66-84f6-7dc58dd24cf8', '2e422166-f088-489c-b3cd-2653c0a94b8b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:02 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:02 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:02 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387" returned: 0 in 0.412s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5b2f08-27b8-4981-886c-812a6000f8e6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:02 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 Aug 26 12:06:02 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:02 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.321s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:02 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f3c33573-32b9-4469-94e9-e9680434e0c6 tempest-GroupsV314Test-1495416298 None] Delete group completed successfully. Aug 26 12:06:03 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036" returned: 0 in 0.404s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:03 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 Aug 26 12:06:03 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:03 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387" returned: 0 in 0.440s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:03 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387 Aug 26 12:06:03 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Flow 'volume_create_manager' (bd1f24db-8de4-4608-83d4-cb4d5d1b1263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a440b7-4282-493c-8125-e927dd2c9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a440b7-4282-493c-8125-e927dd2c9022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1599552925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b90b2552a0b840ecbbc7ccc5a0381cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:04Z,use_quota=True,user_id='26aa9568110148c7816b6ce61a8ba5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c1facc-9061-4257-9d39-84e6cc35ac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c1facc-9061-4257-9d39-84e6cc35ac38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2b1ee5-3a1a-4b1c-acb2-2c98ccd48060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2b1ee5-3a1a-4b1c-acb2-2c98ccd48060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c', 'volume_name': 'volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:03 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df25a578-eb1e-48d4-b3d7-afeb6bcfb69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df25a578-eb1e-48d4-b3d7-afeb6bcfb69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628d3a24-5562-480f-bb69-94380d9dcb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:03 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Volume a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c', 'volume_size': 1} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1599552925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b90b2552a0b840ecbbc7ccc5a0381cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:04Z,use_quota=True,user_id='26aa9568110148c7816b6ce61a8ba5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Creating volume a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:03 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036.472988be-0109-4011-8cc4-eda9427ed387" returned: 0 in 0.406s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:04 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c 1073741824 Aug 26 12:06:04 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-quobyte-472988be-0109-4011-8cc4-eda9427ed387" released by "_delete_snapshot" :: held 1.835s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-quobyte-be60ab1a-6d15-4114-8e4f-eb4336eb0036" released by "delete_snapshot" :: held 1.871s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Created reservations ['2a164735-719a-4d8d-965d-6eab2a39d535', 'c67ee7a3-5b65-4352-a558-e326ba40317e', '7b735101-21ca-49bb-830f-7f55a5dcdad1', '1b7fef5d-6884-41de-897a-9a1e8dbc9820'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Flow 'volume_create_manager' (c074b344-29bd-4ff0-88ef-39749d37346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd1570b-4297-43ab-9d76-007559e42e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:04 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Delete snapshot completed successfully. Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd1570b-4297-43ab-9d76-007559e42e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1396712036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ac4b97-6876-42a0-b836-91ed53ce8a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c293f97314874bc0b266c7961343d4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:04Z,use_quota=True,user_id='576a8fc74da14e61a7d802b2b4b281af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bcf1c9-42f6-45f1-b1c6-eedcf90b9936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bcf1c9-42f6-45f1-b1c6-eedcf90b9936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830b6589-c079-4f93-9889-780f0ca53d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830b6589-c079-4f93-9889-780f0ca53d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ac4b97-6876-42a0-b836-91ed53ce8a04', 'volume_name': 'volume-31ac4b97-6876-42a0-b836-91ed53ce8a04', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1ea98c-67cd-4030-8492-c67d29c787d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1ea98c-67cd-4030-8492-c67d29c787d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184df88d-6b6c-4dee-b281-15fbbf5d8b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:04 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Volume 31ac4b97-6876-42a0-b836-91ed53ce8a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ac4b97-6876-42a0-b836-91ed53ce8a04', 'volume_size': 1} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7302728-8593-4d06-a300-11f463fd507c tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-472988be-0109-4011-8cc4-eda9427ed387-delete_snapshot" released by "delete_snapshot" :: held 2.224s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Acquiring lock "cinder-be60ab1a-6d15-4114-8e4f-eb4336eb0036-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-be60ab1a-6d15-4114-8e4f-eb4336eb0036-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Acquiring lock "cinder-quobyte-be60ab1a-6d15-4114-8e4f-eb4336eb0036" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-quobyte-be60ab1a-6d15-4114-8e4f-eb4336eb0036" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:04 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c 1073741824" returned: 0 in 0.577s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[add69292-20b0-4744-bbd5-007153680182]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:04 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c Aug 26 12:06:04 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:04 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 Aug 26 12:06:04 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:04 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c" returned: 0 in 0.262s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1396712036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ac4b97-6876-42a0-b836-91ed53ce8a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c293f97314874bc0b266c7961343d4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:04Z,use_quota=True,user_id='576a8fc74da14e61a7d802b2b4b281af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Creating volume 31ac4b97-6876-42a0-b836-91ed53ce8a04 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:04 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628d3a24-5562-480f-bb69-94380d9dcb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2116264b-4e0f-48ca-b3fb-350b555b4c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:04 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 1073741824 Aug 26 12:06:04 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:04 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Volume volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c (a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c): created successfully Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2116264b-4e0f-48ca-b3fb-350b555b4c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Flow 'volume_create_manager' (bd1f24db-8de4-4608-83d4-cb4d5d1b1263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:04 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036" returned: 0 in 0.446s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-a56f71d3-932b-44e3-a674-3bd958339974 req-a59dc113-1977-4c28-8790-27c44efd5c79 tempest-VolumesGetTestJSON-1468935023 None] Created volume successfully. Aug 26 12:06:05 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036 Aug 26 12:06:05 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:05 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be60ab1a-6d15-4114-8e4f-eb4336eb0036" returned: 0 in 0.273s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-quobyte-be60ab1a-6d15-4114-8e4f-eb4336eb0036" released by "delete_volume" :: held 0.791s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Created reservations ['0ce78184-6b9a-4fbd-bb8a-3b3ab7bf9bfa', '8c04aa7f-d64d-4db9-8afe-384abfcac215', '0c99559a-8fea-4916-82bf-90201b9a5518', '43327b8f-4b14-4b6b-ba02-aa673cd19dd9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:05 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 1073741824" returned: 0 in 0.606s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:05 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:05 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:05 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 Aug 26 12:06:05 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:05 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.310s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Deleted volume successfully. Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-45c1e764-cf20-41e9-adb3-ef0d25f86c52 tempest-VolumeSnapshotQuotasNegativeTestJSON-752243271 None] Lock "cinder-be60ab1a-6d15-4114-8e4f-eb4336eb0036-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:05 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04" returned: 0 in 0.326s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184df88d-6b6c-4dee-b281-15fbbf5d8b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ac4b97-6876-42a0-b836-91ed53ce8a04', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb980690-c672-4fc7-b0ee-79ca40743a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:05 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Volume volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 (31ac4b97-6876-42a0-b836-91ed53ce8a04): created successfully Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb980690-c672-4fc7-b0ee-79ca40743a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Flow 'volume_create_manager' (c074b344-29bd-4ff0-88ef-39749d37346f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ee3896af-b0d6-495a-b92c-489829bacc6f tempest-VolumesListAdminTestJSON-280938076 None] Created volume successfully. Aug 26 12:06:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Acquiring lock "cinder-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Lock "cinder-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Acquiring lock "cinder-quobyte-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Lock "cinder-quobyte-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:06 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9c09a-9f34-49d8-a038-e103f26b4d3f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:06 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c Aug 26 12:06:06 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:07 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c" returned: 0 in 0.433s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:07 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c Aug 26 12:06:07 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Flow 'volume_create_manager' (aef3519f-cacd-466b-9bac-1847733fca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d5794a-9c49-4dec-932b-dcc0cfe0c36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:07 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d5794a-9c49-4dec-932b-dcc0cfe0c36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fca5f6-28d3-4318-9c70-fd530d5b5d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1fb52f6ea847a5b499933cbf4edb96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:07Z,use_quota=True,user_id='49cebd625f774b26b9f525dfe95bfbe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1bab69-0f27-4bc9-a84d-c7b260baa9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1bab69-0f27-4bc9-a84d-c7b260baa9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f50de7-027b-4f9d-8884-284779b31d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f50de7-027b-4f9d-8884-284779b31d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6fca5f6-28d3-4318-9c70-fd530d5b5d5b', 'volume_name': 'volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dc7e26-c8b4-45d0-a1f4-25b4120c26ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dc7e26-c8b4-45d0-a1f4-25b4120c26ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334101d2-371b-4710-aaa3-0d0136ec2956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:07 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Volume b6fca5f6-28d3-4318-9c70-fd530d5b5d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b', 'volume_size': 1} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fca5f6-28d3-4318-9c70-fd530d5b5d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1fb52f6ea847a5b499933cbf4edb96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:07Z,use_quota=True,user_id='49cebd625f774b26b9f525dfe95bfbe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Creating volume b6fca5f6-28d3-4318-9c70-fd530d5b5d5b {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:07 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c" returned: 0 in 0.500s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Lock "cinder-quobyte-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c" released by "delete_volume" :: held 0.990s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:07 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b 1073741824 Aug 26 12:06:07 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.quota [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Created reservations ['870bf451-ccb0-4dfe-9988-83078f9f273a', '90aae268-3556-403b-86e6-464d8403d87f', 'c641917b-c992-47f5-a499-87e428d001cb', 'e1db6fd7-9beb-42ec-b4c0-6aac21d23df2'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:07 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:07 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:08 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.354s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG cinder.manager [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:08 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Deleted volume successfully. Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-5afeaf2a-3584-4741-98c9-26abcf29a180 req-3c470bb6-ecad-4c97-b91a-fa93c28ff06e tempest-VolumesGetTestJSON-1468935023 None] Lock "cinder-a308ac16-c15c-46c0-a2ab-ce8fa16e5d1c-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:08 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b 1073741824" returned: 0 in 0.641s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:08 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b Aug 26 12:06:08 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:08 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b" returned: 0 in 0.351s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=126,cinder:UPDATE=176,cinder:INSERT=37,cinder:DELETE=15 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334101d2-371b-4710-aaa3-0d0136ec2956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb7dd48-718f-437f-a9e9-56ef1f7b9055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:08 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Volume volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b (b6fca5f6-28d3-4318-9c70-fd530d5b5d5b): created successfully Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb7dd48-718f-437f-a9e9-56ef1f7b9055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Flow 'volume_create_manager' (aef3519f-cacd-466b-9bac-1847733fca72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:08 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-02633e26-632e-45c3-a7b0-607596f4c16c tempest-VolumesListAdminTestJSON-1286369059 None] Created volume successfully. Aug 26 12:06:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Acquiring lock "cinder-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Lock "cinder-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:09 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=173,cinder:SELECT=132,cinder:DELETE=13,cinder:INSERT=40 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:06:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Acquiring lock "cinder-quobyte-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Lock "cinder-quobyte-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b" acquired by "delete_volume" :: waited 0.046s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9d4a6c-4d73-4fea-acb1-d1fa930327d4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "cinder-31ac4b97-6876-42a0-b836-91ed53ce8a04-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d4b90b44-86db-42f4-8d03-407868d0291b tempest-GroupsV320Test-1841673700 None] Group tempest-GroupsV320Test-Group-461277954: creating Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-31ac4b97-6876-42a0-b836-91ed53ce8a04-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d4b90b44-86db-42f4-8d03-407868d0291b tempest-GroupsV320Test-1841673700 None] Group tempest-GroupsV320Test-Group-461277954: created successfully Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "cinder-quobyte-31ac4b97-6876-42a0-b836-91ed53ce8a04" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d4b90b44-86db-42f4-8d03-407868d0291b tempest-GroupsV320Test-1841673700 None] Create group completed successfully. Aug 26 12:06:10 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b Aug 26 12:06:10 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-quobyte-31ac4b97-6876-42a0-b836-91ed53ce8a04" acquired by "delete_volume" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b9ff31-b179-4218-8818-93bc1f4d328a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:10 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 Aug 26 12:06:10 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:10 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b" returned: 0 in 0.430s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:10 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b Aug 26 12:06:10 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:10 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:10 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:10 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04" returned: 0 in 0.451s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:10 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04 Aug 26 12:06:10 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:10 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b" returned: 0 in 0.333s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Lock "cinder-quobyte-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b" released by "delete_volume" :: held 0.847s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:10 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.304s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:06:10 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Created reservations ['b74e273d-8df2-4745-84ed-6586ea3baef1', '0613976b-22a9-4929-b730-ef5460c55c35', '2c2b25a4-5820-4867-b206-844671e55ee8', '4fd244f0-aef4-4a01-9553-67d3dc0b91a0'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:11 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-31ac4b97-6876-42a0-b836-91ed53ce8a04" returned: 0 in 0.354s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:11 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:11 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-quobyte-31ac4b97-6876-42a0-b836-91ed53ce8a04" released by "delete_volume" :: held 0.853s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Created reservations ['a06ccf97-6151-4407-a8cf-1df39cd39740', '34679b73-7d6c-4294-965b-1a58821177de', 'b5492177-bab8-4278-b955-7d977b5dd6a0', '9843bd74-fb96-4644-9918-033fdc78b569'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:11 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:11 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:11 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.433s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:11 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Deleted volume successfully. Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0dd82cd2-7ff6-40dd-8111-84badb529d7b tempest-VolumesListAdminTestJSON-1286369059 None] Lock "cinder-b6fca5f6-28d3-4318-9c70-fd530d5b5d5b-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:11 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.355s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:11 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Deleted volume successfully. Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-49f5ebc3-3162-46c1-b2a9-11ace15b4254 tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-31ac4b97-6876-42a0-b836-91ed53ce8a04-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] Created reservations ['60c5d502-2912-4305-8580-9f9c547124e6'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:11 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:11 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:12 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.274s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:12 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4d63538d-8a57-4aa9-8962-05e83425eb9c tempest-GroupsV320Test-1841673700 None] Delete group completed successfully. Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "cinder-c59665cf-93d6-4700-b1c7-258158e55f6d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-c59665cf-93d6-4700-b1c7-258158e55f6d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "cinder-quobyte-c59665cf-93d6-4700-b1c7-258158e55f6d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-quobyte-c59665cf-93d6-4700-b1c7-258158e55f6d" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ebce05-d2bc-47e5-a015-90d48ec40001]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:12 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d Aug 26 12:06:12 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:12 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d" returned: 0 in 0.400s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:12 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d Aug 26 12:06:12 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5a2f1f1c-c17a-4eb6-97e2-2ce74d29bd37 tempest-GroupsTest-1502645795 None] Group tempest-Group1-240921810: creating Aug 26 12:06:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5a2f1f1c-c17a-4eb6-97e2-2ce74d29bd37 tempest-GroupsTest-1502645795 None] Group tempest-Group1-240921810: created successfully Aug 26 12:06:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5a2f1f1c-c17a-4eb6-97e2-2ce74d29bd37 tempest-GroupsTest-1502645795 None] Create group completed successfully. Aug 26 12:06:13 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-c59665cf-93d6-4700-b1c7-258158e55f6d" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-quobyte-c59665cf-93d6-4700-b1c7-258158e55f6d" released by "delete_volume" :: held 0.798s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Created reservations ['01185d5a-74c8-4faa-aa86-daa87bf518c1', 'd3a81301-1212-48ec-9c1d-e55ac1e4d2fe', '65a4ff87-fe7d-4d58-828d-9bde008a7d13', '9b09c6b4-c652-4fa4-afde-7bfdcbdd333f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:13 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:13 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "cinder-46919a9e-8aec-4932-9c37-75ba309cacd7-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-46919a9e-8aec-4932-9c37-75ba309cacd7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:13 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.370s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "cinder-quobyte-46919a9e-8aec-4932-9c37-75ba309cacd7" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Deleted volume successfully. Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-quobyte-46919a9e-8aec-4932-9c37-75ba309cacd7" acquired by "delete_volume" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f304c1c2-d82b-46b7-b627-a5dd6f0d1d2a tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-c59665cf-93d6-4700-b1c7-258158e55f6d-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b67908-1d98-4119-9ed1-533cf8917509]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:14 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7 Aug 26 12:06:14 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:14 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7" returned: 0 in 0.433s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:14 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7 Aug 26 12:06:14 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3e2aa331-ee3f-4af0-81e3-6d048cc67d72 tempest-GroupsTest-1502645795 None] Group tempest-Group2-466126125: creating Aug 26 12:06:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3e2aa331-ee3f-4af0-81e3-6d048cc67d72 tempest-GroupsTest-1502645795 None] Group tempest-Group2-466126125: created successfully Aug 26 12:06:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3e2aa331-ee3f-4af0-81e3-6d048cc67d72 tempest-GroupsTest-1502645795 None] Create group completed successfully. Aug 26 12:06:14 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-46919a9e-8aec-4932-9c37-75ba309cacd7" returned: 0 in 0.312s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-quobyte-46919a9e-8aec-4932-9c37-75ba309cacd7" released by "delete_volume" :: held 0.798s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Created reservations ['1303c709-3063-4fa6-99cd-9ccea316fdad', '1353a74d-f20c-4149-a7c7-65bc481f7915', 'a2cf0222-5ab7-4377-acf1-6c13b079380f', 'a4ef3527-553e-4067-b431-ead0ac7c1690'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:14 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:14 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:15 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.328s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:15 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Deleted volume successfully. Aug 26 12:06:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e6508219-9789-44b0-9506-688185db15d6 tempest-VolumesListAdminTestJSON-280938076 None] Lock "cinder-46919a9e-8aec-4932-9c37-75ba309cacd7-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Flow 'volume_create_manager' (d36780f4-fbc8-45e7-8c7c-2bbbdb7adaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54daaa56-96e9-4e4f-bbd5-c275749d21f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54daaa56-96e9-4e4f-bbd5-c275749d21f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1851627350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0172a2a-4b31-49b1-8cd7-2e522de85b64,host='devstack@QuobyteHD#QuobyteHD',id=33333d2c-f4d4-4e61-9a00-d0bd666255a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4851f4d332354d3f94b7c3199a20c3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:16Z,use_quota=True,user_id='46067200b251429e8247e077102aadb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be088f89-d18e-4826-b396-21de4d650a7c),volume_type_id=be088f89-d18e-4826-b396-21de4d650a7c)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28890800-99ea-4fe3-957d-fba4602fcaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28890800-99ea-4fe3-957d-fba4602fcaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9873c37-872a-4d2a-95f4-703a75fda29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9873c37-872a-4d2a-95f4-703a75fda29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33333d2c-f4d4-4e61-9a00-d0bd666255a6', 'volume_name': 'volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16404d1-53e4-4a37-ae21-386b33caa2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16404d1-53e4-4a37-ae21-386b33caa2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9675c2c-7539-4893-b606-83ca9fe2934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:16 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Volume 33333d2c-f4d4-4e61-9a00-d0bd666255a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6', 'volume_size': 1} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0172a2a-4b31-49b1-8cd7-2e522de85b64,created_at=2026-08-26T10:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1851627350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0172a2a-4b31-49b1-8cd7-2e522de85b64,host='devstack@QuobyteHD#QuobyteHD',id=33333d2c-f4d4-4e61-9a00-d0bd666255a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4851f4d332354d3f94b7c3199a20c3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:16Z,use_quota=True,user_id='46067200b251429e8247e077102aadb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be088f89-d18e-4826-b396-21de4d650a7c),volume_type_id=be088f89-d18e-4826-b396-21de4d650a7c)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Creating volume 33333d2c-f4d4-4e61-9a00-d0bd666255a6 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:16 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:16 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 1073741824 Aug 26 12:06:16 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:16 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 1073741824" returned: 0 in 0.553s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:16 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 Aug 26 12:06:16 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:17 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6" returned: 0 in 0.420s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9675c2c-7539-4893-b606-83ca9fe2934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32429af1-453f-44b3-9b99-6151c6a348f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Volume volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 (33333d2c-f4d4-4e61-9a00-d0bd666255a6): created successfully Aug 26 12:06:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32429af1-453f-44b3-9b99-6151c6a348f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Flow 'volume_create_manager' (d36780f4-fbc8-45e7-8c7c-2bbbdb7adaaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:17 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2626e371-def2-481c-8928-5e72d6a20d5a tempest-GroupsTest-1502645795 None] Created volume successfully. Aug 26 12:06:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Acquiring lock "cinder-quobyte-33333d2c-f4d4-4e61-9a00-d0bd666255a6" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Lock "cinder-quobyte-33333d2c-f4d4-4e61-9a00-d0bd666255a6" acquired by "delete_volume" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:19 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[186d9d43-3878-4676-97cf-d7027614105f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:19 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 Aug 26 12:06:19 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:19 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6" returned: 0 in 0.497s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:19 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6 Aug 26 12:06:19 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33333d2c-f4d4-4e61-9a00-d0bd666255a6" returned: 0 in 0.310s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:20 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Lock "cinder-quobyte-33333d2c-f4d4-4e61-9a00-d0bd666255a6" released by "delete_volume" :: held 0.882s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Created reservations ['52935582-cdfd-4c75-9936-dce9e378ab5b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:20 devstack cinder-volume[94387]: WARNING cinder.quota [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1066023452 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1066023452, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:06:20 devstack cinder-volume[94387]: WARNING cinder.quota [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1066023452 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1066023452, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Created reservations ['2f73a6b8-8c79-48e2-8295-accd8f2538e9', '22dde279-63bb-48fa-a795-f9e3d13c8c3a', '83ef0951-2570-407e-bf98-2b1be1647720', '4d5415c5-3e93-4650-91cb-8e340d4780e0'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:20 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:20 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:21 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.385s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:21 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5c0fb273-ee75-4a2b-a535-f1d3b0729b32 tempest-GroupsTest-1502645795 None] Delete group completed successfully. Aug 26 12:06:21 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] Created reservations ['4afd9de0-1f81-4d7a-a8c8-4ac1578be065'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:22 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:22 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:22 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.320s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:22 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:22 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2619711c-6e3d-4910-a707-9a1278ccad7f tempest-GroupsTest-1502645795 None] Delete group completed successfully. Aug 26 12:06:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-29c035c8-f8a5-4e6d-af06-a82e1e5ec124 tempest-GroupsTest-1502645795 None] Group tempest-GroupsTest-Group-1695682133: creating Aug 26 12:06:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-29c035c8-f8a5-4e6d-af06-a82e1e5ec124 tempest-GroupsTest-1502645795 None] Group tempest-GroupsTest-Group-1695682133: created successfully Aug 26 12:06:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-29c035c8-f8a5-4e6d-af06-a82e1e5ec124 tempest-GroupsTest-1502645795 None] Create group completed successfully. Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Flow 'volume_create_manager' (7fca7439-574e-4c41-b797-e52378bb2ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047617ee-60bb-4a2e-857b-f1f64cd906ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047617ee-60bb-4a2e-857b-f1f64cd906ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504242318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=521c33c9-bc42-41f0-92cf-47b7e66f9373,host='devstack@QuobyteHD#QuobyteHD',id=5b461039-258f-4a09-bf47-fe7bb5b2b385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4851f4d332354d3f94b7c3199a20c3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:25Z,use_quota=True,user_id='46067200b251429e8247e077102aadb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d94a51e-e5f4-4e68-b464-6644f9112539),volume_type_id=3d94a51e-e5f4-4e68-b464-6644f9112539)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91d5ac0-9731-442e-b195-dd50ed62ade4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91d5ac0-9731-442e-b195-dd50ed62ade4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a1993d-8bd0-4ecc-a6a8-b6707d4d65e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a1993d-8bd0-4ecc-a6a8-b6707d4d65e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b461039-258f-4a09-bf47-fe7bb5b2b385', 'volume_name': 'volume-5b461039-258f-4a09-bf47-fe7bb5b2b385', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1747fee-770f-430b-98ef-1b008d0a992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1747fee-770f-430b-98ef-1b008d0a992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d0a97a-6b54-42b8-8def-6eb5bbb43be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:25 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Volume 5b461039-258f-4a09-bf47-fe7bb5b2b385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b461039-258f-4a09-bf47-fe7bb5b2b385', 'volume_size': 1} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=521c33c9-bc42-41f0-92cf-47b7e66f9373,created_at=2026-08-26T10:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504242318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=521c33c9-bc42-41f0-92cf-47b7e66f9373,host='devstack@QuobyteHD#QuobyteHD',id=5b461039-258f-4a09-bf47-fe7bb5b2b385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4851f4d332354d3f94b7c3199a20c3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:25Z,use_quota=True,user_id='46067200b251429e8247e077102aadb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d94a51e-e5f4-4e68-b464-6644f9112539),volume_type_id=3d94a51e-e5f4-4e68-b464-6644f9112539)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Creating volume 5b461039-258f-4a09-bf47-fe7bb5b2b385 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:25 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:25 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 1073741824 Aug 26 12:06:25 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:26 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 1073741824" returned: 0 in 0.562s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:26 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 Aug 26 12:06:26 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:26 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385" returned: 0 in 0.290s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d0a97a-6b54-42b8-8def-6eb5bbb43be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b461039-258f-4a09-bf47-fe7bb5b2b385', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b597897a-23fe-420e-8952-2745a84a728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:26 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Volume volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 (5b461039-258f-4a09-bf47-fe7bb5b2b385): created successfully Aug 26 12:06:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b597897a-23fe-420e-8952-2745a84a728f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Flow 'volume_create_manager' (7fca7439-574e-4c41-b797-e52378bb2ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:26 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f0fca48f-31d7-4c85-9f67-49053d21d79c tempest-GroupsTest-1502645795 None] Created volume successfully. Aug 26 12:06:28 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Flow 'volume_create_manager' (0c3567ef-b5f0-466d-bee0-3c4531e3206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58fe139-3adf-493f-a121-da6bc6ff13fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58fe139-3adf-493f-a121-da6bc6ff13fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-664297490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=521c33c9-bc42-41f0-92cf-47b7e66f9373,host='devstack@QuobyteHD#QuobyteHD',id=8899c603-dc44-44a9-b9f9-9275947f2cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4851f4d332354d3f94b7c3199a20c3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:29Z,use_quota=True,user_id='46067200b251429e8247e077102aadb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d94a51e-e5f4-4e68-b464-6644f9112539),volume_type_id=3d94a51e-e5f4-4e68-b464-6644f9112539)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e1eea3-2374-43e9-b037-1c9e14781304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e1eea3-2374-43e9-b037-1c9e14781304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ceb25d-406a-4fe3-b96d-e99f3d093859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ceb25d-406a-4fe3-b96d-e99f3d093859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8899c603-dc44-44a9-b9f9-9275947f2cf6', 'volume_name': 'volume-8899c603-dc44-44a9-b9f9-9275947f2cf6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d2b620-ec0f-4bf5-a229-64682b5fd167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d2b620-ec0f-4bf5-a229-64682b5fd167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53f6333-06ae-4e5d-971b-ebdb3f960df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:29 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Volume 8899c603-dc44-44a9-b9f9-9275947f2cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8899c603-dc44-44a9-b9f9-9275947f2cf6', 'volume_size': 1} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=521c33c9-bc42-41f0-92cf-47b7e66f9373,created_at=2026-08-26T10:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-664297490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=521c33c9-bc42-41f0-92cf-47b7e66f9373,host='devstack@QuobyteHD#QuobyteHD',id=8899c603-dc44-44a9-b9f9-9275947f2cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4851f4d332354d3f94b7c3199a20c3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:29Z,use_quota=True,user_id='46067200b251429e8247e077102aadb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d94a51e-e5f4-4e68-b464-6644f9112539),volume_type_id=3d94a51e-e5f4-4e68-b464-6644f9112539)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Creating volume 8899c603-dc44-44a9-b9f9-9275947f2cf6 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:29 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:29 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 1073741824 Aug 26 12:06:29 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:29 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 1073741824" returned: 0 in 0.649s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:29 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 Aug 26 12:06:29 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:30 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6" returned: 0 in 0.348s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53f6333-06ae-4e5d-971b-ebdb3f960df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8899c603-dc44-44a9-b9f9-9275947f2cf6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb9d617-0ce1-41b0-9806-ddbd1b164b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:30 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Volume volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 (8899c603-dc44-44a9-b9f9-9275947f2cf6): created successfully Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb9d617-0ce1-41b0-9806-ddbd1b164b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Flow 'volume_create_manager' (0c3567ef-b5f0-466d-bee0-3c4531e3206d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-27e6ad80-f3de-4ad4-86db-f16850aec5bd tempest-GroupsTest-1502645795 None] Created volume successfully. Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Flow 'volume_create_manager' (8f7006ba-fed8-463d-8630-23e3cb85adf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ae4bfd-ab48-444b-a4db-5776ae3c4e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ae4bfd-ab48-444b-a4db-5776ae3c4e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1724742512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1799c0-fcc3-4504-958e-c327f00f0fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d7de88ebf746bd9b32d6f546e5d1b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:31Z,use_quota=True,user_id='40adaf06fa354db6bcb90a1f7356724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc0dd12-93dc-4f13-b9f5-e9bd1e546fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc0dd12-93dc-4f13-b9f5-e9bd1e546fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57dfac2-60e5-4497-98c4-8603f6d8d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57dfac2-60e5-4497-98c4-8603f6d8d485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1799c0-fcc3-4504-958e-c327f00f0fb5', 'volume_name': 'volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7be6d23-3274-421c-9d95-4603bbbd2dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7be6d23-3274-421c-9d95-4603bbbd2dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddb03f7-6bb2-48b2-80a9-6cb1e8b529fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:30 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Volume 6e1799c0-fcc3-4504-958e-c327f00f0fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5', 'volume_size': 1} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1724742512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1799c0-fcc3-4504-958e-c327f00f0fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d7de88ebf746bd9b32d6f546e5d1b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:31Z,use_quota=True,user_id='40adaf06fa354db6bcb90a1f7356724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Creating volume 6e1799c0-fcc3-4504-958e-c327f00f0fb5 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:30 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:30 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 1073741824 Aug 26 12:06:30 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:31 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 1073741824" returned: 0 in 0.629s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Flow 'volume_create_manager' (3e6706f4-480a-49c1-8192-c2dad5b68d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697653f1-5c57-4751-aae7-dd090fa8df03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697653f1-5c57-4751-aae7-dd090fa8df03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1040772892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588d6197-4bb8-43b0-a80e-295a8c23bc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb81eb645ee4ac8a1a1cc2115677647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:31Z,use_quota=True,user_id='b41438c650044a2d846627a4ee90571e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba3998e-7b87-489c-bc8e-4f58319d1b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba3998e-7b87-489c-bc8e-4f58319d1b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28aa2995-eb0e-4193-ac1f-62ee4daf2741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28aa2995-eb0e-4193-ac1f-62ee4daf2741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588d6197-4bb8-43b0-a80e-295a8c23bc17', 'volume_name': 'volume-588d6197-4bb8-43b0-a80e-295a8c23bc17', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e68de42-44fc-4e4f-8366-4dafec609b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e68de42-44fc-4e4f-8366-4dafec609b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88196efe-00b8-4478-bbe8-11154da8bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:31 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Volume 588d6197-4bb8-43b0-a80e-295a8c23bc17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588d6197-4bb8-43b0-a80e-295a8c23bc17', 'volume_size': 1} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:31 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b3d44126-529d-45e3-b7e1-eac2563601ef tempest-GroupsTest-1502645795 None] Update group completed successfully. Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:31 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 Aug 26 12:06:31 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:31 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5" returned: 0 in 0.263s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.300s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1040772892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588d6197-4bb8-43b0-a80e-295a8c23bc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb81eb645ee4ac8a1a1cc2115677647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:31Z,use_quota=True,user_id='b41438c650044a2d846627a4ee90571e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Creating volume 588d6197-4bb8-43b0-a80e-295a8c23bc17 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:31 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddb03f7-6bb2-48b2-80a9-6cb1e8b529fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:31 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 1073741824 Aug 26 12:06:31 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8208d15-cbd3-45ab-93ae-8c29c456d6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:32 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Volume volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 (6e1799c0-fcc3-4504-958e-c327f00f0fb5): created successfully Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8208d15-cbd3-45ab-93ae-8c29c456d6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Flow 'volume_create_manager' (8f7006ba-fed8-463d-8630-23e3cb85adf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:32 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f8fd102e-40a1-4fd5-8633-a6c09848bc05 tempest-AbsoluteLimitsTests-661825658 None] Created volume successfully. Aug 26 12:06:32 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 1073741824" returned: 0 in 0.496s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:32 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 Aug 26 12:06:32 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:32 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17" returned: 0 in 0.331s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88196efe-00b8-4478-bbe8-11154da8bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588d6197-4bb8-43b0-a80e-295a8c23bc17', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d899c6ab-5cba-4d18-8cfc-83dd2b5b1eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:32 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Volume volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 (588d6197-4bb8-43b0-a80e-295a8c23bc17): created successfully Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d899c6ab-5cba-4d18-8cfc-83dd2b5b1eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Flow 'volume_create_manager' (3e6706f4-480a-49c1-8192-c2dad5b68d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Acquiring lock "cinder-6e1799c0-fcc3-4504-958e-c327f00f0fb5-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:32 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f4d3f850-c81c-4e9d-be5f-92d655937957 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Created volume successfully. Aug 26 12:06:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Lock "cinder-6e1799c0-fcc3-4504-958e-c327f00f0fb5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Acquiring lock "cinder-quobyte-6e1799c0-fcc3-4504-958e-c327f00f0fb5" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:33 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-aadb8fa9-4cc1-45ba-ad47-4e9323823cb2 tempest-GroupsTest-1502645795 None] Update group completed successfully. Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Lock "cinder-quobyte-6e1799c0-fcc3-4504-958e-c327f00f0fb5" acquired by "delete_volume" :: waited 0.045s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc29c0a7-b380-471e-a606-f7152c64009a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:33 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 Aug 26 12:06:33 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:33 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5" returned: 0 in 0.411s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:33 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5 Aug 26 12:06:33 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:33 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6e1799c0-fcc3-4504-958e-c327f00f0fb5" returned: 0 in 0.267s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Lock "cinder-quobyte-6e1799c0-fcc3-4504-958e-c327f00f0fb5" released by "delete_volume" :: held 0.733s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Created reservations ['8bedf5b4-2e0a-46c1-82d9-7bce4c794159', '105ce071-8d81-494b-919d-2e94948df84b', 'e5bf38b1-9657-4017-9423-649f3e150bcf', '9881c2dd-438a-4ec7-b578-b670b65d3619'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:33 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:33 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:34 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.492s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Deleted volume successfully. Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2d9a54a4-173b-42bf-a5a1-b9fbafc06588 tempest-AbsoluteLimitsTests-661825658 None] Lock "cinder-6e1799c0-fcc3-4504-958e-c327f00f0fb5-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Acquiring lock "cinder-588d6197-4bb8-43b0-a80e-295a8c23bc17-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "cinder-588d6197-4bb8-43b0-a80e-295a8c23bc17-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Acquiring lock "cinder-quobyte-5b461039-258f-4a09-bf47-fe7bb5b2b385" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Lock "cinder-quobyte-5b461039-258f-4a09-bf47-fe7bb5b2b385" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Acquiring lock "cinder-quobyte-588d6197-4bb8-43b0-a80e-295a8c23bc17" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "cinder-quobyte-588d6197-4bb8-43b0-a80e-295a8c23bc17" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[06012abc-70ba-4d60-b485-a2dc05caa43f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ea107b-8a22-4101-b690-2d29ef7d8ba5]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:35 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 Aug 26 12:06:35 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:35 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 Aug 26 12:06:35 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:35 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385" returned: 0 in 0.526s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:35 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385 Aug 26 12:06:35 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:35 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17" returned: 0 in 0.580s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:35 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17 Aug 26 12:06:35 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:35 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5b461039-258f-4a09-bf47-fe7bb5b2b385" returned: 0 in 0.317s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Lock "cinder-quobyte-5b461039-258f-4a09-bf47-fe7bb5b2b385" released by "delete_volume" :: held 0.924s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Acquiring lock "cinder-quobyte-8899c603-dc44-44a9-b9f9-9275947f2cf6" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Lock "cinder-quobyte-8899c603-dc44-44a9-b9f9-9275947f2cf6" acquired by "delete_volume" :: waited 0.033s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:35 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-588d6197-4bb8-43b0-a80e-295a8c23bc17" returned: 0 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "cinder-quobyte-588d6197-4bb8-43b0-a80e-295a8c23bc17" released by "delete_volume" :: held 0.982s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c520c-bca1-4c77-9eb2-5c6fba704d5a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:35 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Created reservations ['ab2c9904-2350-4326-a75d-e11577ae225c', '5fa2841e-6793-4eb5-bd44-5a3dcf5005b1', '1b83261c-4b59-4494-8005-8ad4614466aa', '7ee7ca40-b97e-41b9-a18c-e3f1bbb99f2e'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:36 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 Aug 26 12:06:36 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:36 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:36 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:36 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6" returned: 0 in 0.504s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:36 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6 Aug 26 12:06:36 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:36 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.323s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Deleted volume successfully. Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8589942d-917c-4eec-a819-a55bced32ec5 tempest-VolumeQuotasNegativeTestJSON-1812215317 None] Lock "cinder-588d6197-4bb8-43b0-a80e-295a8c23bc17-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:36 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8899c603-dc44-44a9-b9f9-9275947f2cf6" returned: 0 in 0.317s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Lock "cinder-quobyte-8899c603-dc44-44a9-b9f9-9275947f2cf6" released by "delete_volume" :: held 0.912s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Created reservations ['a3148e9c-d2e9-433e-8cbf-54b8c8bd4f65'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:36 devstack cinder-volume[94387]: WARNING cinder.quota [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1200734846 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1200734846, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:06:36 devstack cinder-volume[94387]: WARNING cinder.quota [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1200734846 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1200734846, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:06:36 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Created reservations ['05b13235-2d4e-4d8e-bab8-b03569655312', '1453f8aa-9a89-41d3-aa9e-0897944ee81f', 'a84c7a82-4a0e-4c17-a462-2366f4e455e3', '604f51e3-5204-4366-907a-15c23f754111'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:37 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Created reservations ['ae605785-aed6-4075-828a-25bae3a60050', '5c373d6d-7ef8-49a7-a958-629904dc24ee', '12c337ad-84fc-435f-bfc8-00a05751a191', '31ee423a-0dce-4c0d-bac0-c24e79f4093a'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:37 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:37 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:37 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.592s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:37 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:37 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-645c5480-c464-4461-a55d-c6d187842908 tempest-GroupsTest-1502645795 None] Delete group completed successfully. Aug 26 12:06:42 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Flow 'volume_create_manager' (20c10164-da92-4713-b8a0-426362cdfaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72205f8c-4d97-4aa1-9416-86fbd3cc53bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72205f8c-4d97-4aa1-9416-86fbd3cc53bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1640778086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d34541-ca64-4cf6-913b-efdd868fbcd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd101acb5604021ac7237bcb2d32582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:43Z,use_quota=True,user_id='7200ac90632148afbb39a362590bedc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b5b4d0-1a72-4a54-92ec-2718a245cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b5b4d0-1a72-4a54-92ec-2718a245cd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effb31f7-0475-4a9c-85da-99fbd046bebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effb31f7-0475-4a9c-85da-99fbd046bebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d34541-ca64-4cf6-913b-efdd868fbcd4', 'volume_name': 'volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cb5757-a9f0-466f-a7d1-509b180f3b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cb5757-a9f0-466f-a7d1-509b180f3b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603f5ecf-d343-4858-8229-a301390e9784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Volume b8d34541-ca64-4cf6-913b-efdd868fbcd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4', 'volume_size': 1} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1640778086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d34541-ca64-4cf6-913b-efdd868fbcd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd101acb5604021ac7237bcb2d32582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:43Z,use_quota=True,user_id='7200ac90632148afbb39a362590bedc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Creating volume b8d34541-ca64-4cf6-913b-efdd868fbcd4 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:43 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:43 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 1073741824 Aug 26 12:06:43 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:43 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 1073741824" returned: 0 in 0.736s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:44 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 Aug 26 12:06:44 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:44 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4" returned: 0 in 0.338s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603f5ecf-d343-4858-8229-a301390e9784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a283071e-6c7c-4d67-a4e3-653591daf050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:44 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Volume volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 (b8d34541-ca64-4cf6-913b-efdd868fbcd4): created successfully Aug 26 12:06:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a283071e-6c7c-4d67-a4e3-653591daf050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Flow 'volume_create_manager' (20c10164-da92-4713-b8a0-426362cdfaf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a30c5867-9f36-416b-a101-89f121fd47a1 tempest-VolumesTransfersV357Test-1243990894 None] Created volume successfully. Aug 26 12:06:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d38e2eab-2fb8-48c4-ae4c-5d7c33099ec5 tempest-VolumesTransfersV357Test-1211087389 None] Transfer volume completed successfully. Aug 26 12:06:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Acquiring lock "cinder-b8d34541-ca64-4cf6-913b-efdd868fbcd4-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Lock "cinder-b8d34541-ca64-4cf6-913b-efdd868fbcd4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Acquiring lock "cinder-quobyte-b8d34541-ca64-4cf6-913b-efdd868fbcd4" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Lock "cinder-quobyte-b8d34541-ca64-4cf6-913b-efdd868fbcd4" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dee025f-9c9d-455a-bbf5-68c3f636bdd0]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:47 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 Aug 26 12:06:47 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:47 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4" returned: 0 in 0.466s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:47 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4 Aug 26 12:06:47 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:48 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b8d34541-ca64-4cf6-913b-efdd868fbcd4" returned: 0 in 0.462s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Lock "cinder-quobyte-b8d34541-ca64-4cf6-913b-efdd868fbcd4" released by "delete_volume" :: held 1.016s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Created reservations ['8b73e752-7cc4-42e7-b246-0c84b566bac0', '926b418a-569e-4871-ab16-08f4e4ffa415', '803fa344-f7ee-44dd-8a83-a61cf4592296', '9c4068dd-2624-46b5-9e44-991db1dd5eaf'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:48 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:48 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:48 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.325s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Deleted volume successfully. Aug 26 12:06:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc12f123-7928-42df-a1ee-dece2958197e tempest-VolumesTransfersV357Test-1897037720 None] Lock "cinder-b8d34541-ca64-4cf6-913b-efdd868fbcd4-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Flow 'volume_create_manager' (a75ded2c-7038-49a1-a634-ca8a9baf0bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b214e72-3f43-4458-b2c6-db7e037d97cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b214e72-3f43-4458-b2c6-db7e037d97cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-948190385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3229bf7e30234f85aa0ffd9ec79974f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:50Z,use_quota=True,user_id='b4a751a837ea4c4691111f27908f4057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6d1c3e1-55f5-4219-bb67-83aeade93100),volume_type_id=c6d1c3e1-55f5-4219-bb67-83aeade93100)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c31115-cdd5-44ed-bfac-c9359109a391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c31115-cdd5-44ed-bfac-c9359109a391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff8e55e-caa8-4cc9-bd06-f0114874874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff8e55e-caa8-4cc9-bd06-f0114874874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16', 'volume_name': 'volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da2d9f7-65e4-43b8-86d2-7f2b2cbe9696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da2d9f7-65e4-43b8-86d2-7f2b2cbe9696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007f3747-082d-4a57-b432-442c977a3325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:49 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Volume f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16', 'volume_size': 1} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-948190385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3229bf7e30234f85aa0ffd9ec79974f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:50Z,use_quota=True,user_id='b4a751a837ea4c4691111f27908f4057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6d1c3e1-55f5-4219-bb67-83aeade93100),volume_type_id=c6d1c3e1-55f5-4219-bb67-83aeade93100)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Creating volume f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:49 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:50 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 1073741824 Aug 26 12:06:50 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Flow 'volume_create_manager' (8601420d-ad72-4a94-90fb-b7c0dee7fd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479b7b77-85cd-469a-af9a-dcd98d099f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479b7b77-85cd-469a-af9a-dcd98d099f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1500858808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9457be5-4b5a-47f6-9905-3309665fed1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd101acb5604021ac7237bcb2d32582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:50Z,use_quota=True,user_id='7200ac90632148afbb39a362590bedc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfc6045-4c6c-456a-86f5-b3453302e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfc6045-4c6c-456a-86f5-b3453302e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98295629-7f52-4a69-8c3f-27f49878e152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98295629-7f52-4a69-8c3f-27f49878e152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9457be5-4b5a-47f6-9905-3309665fed1e', 'volume_name': 'volume-b9457be5-4b5a-47f6-9905-3309665fed1e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a23269f-a900-47ae-bb85-3a8a3f487a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a23269f-a900-47ae-bb85-3a8a3f487a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2fac69-db5d-4f7e-88a5-9720085c76a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:50 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Volume b9457be5-4b5a-47f6-9905-3309665fed1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9457be5-4b5a-47f6-9905-3309665fed1e', 'volume_size': 1} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:50 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 1073741824" returned: 0 in 0.645s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:50 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 Aug 26 12:06:50 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:51 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16" returned: 0 in 0.525s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1500858808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9457be5-4b5a-47f6-9905-3309665fed1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd101acb5604021ac7237bcb2d32582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:50Z,use_quota=True,user_id='7200ac90632148afbb39a362590bedc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Creating volume b9457be5-4b5a-47f6-9905-3309665fed1e {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:51 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007f3747-082d-4a57-b432-442c977a3325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:51 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e 1073741824 Aug 26 12:06:51 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f33134-599c-4bbf-9379-814ba144f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:51 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Volume volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 (f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16): created successfully Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f33134-599c-4bbf-9379-814ba144f04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Flow 'volume_create_manager' (a75ded2c-7038-49a1-a634-ca8a9baf0bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2fc1816b-b121-40ef-9f91-4b5a3429010c tempest-VolumeTypesAccessTest-165934211 None] Created volume successfully. Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Acquiring lock "cinder-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:52 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e 1073741824" returned: 0 in 0.977s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Lock "cinder-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Acquiring lock "cinder-quobyte-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:52 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e Aug 26 12:06:52 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Lock "cinder-quobyte-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a817ef56-a1f7-4e80-b750-e713f692ce26]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:52 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 Aug 26 12:06:52 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:52 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e" returned: 0 in 0.500s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2fac69-db5d-4f7e-88a5-9720085c76a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9457be5-4b5a-47f6-9905-3309665fed1e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a7c874-9949-451f-b4d7-2c4e739211af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:52 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Volume volume-b9457be5-4b5a-47f6-9905-3309665fed1e (b9457be5-4b5a-47f6-9905-3309665fed1e): created successfully Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a7c874-9949-451f-b4d7-2c4e739211af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Flow 'volume_create_manager' (8601420d-ad72-4a94-90fb-b7c0dee7fd97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:52 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-eba9a10d-8579-4649-a877-68dc298257cf tempest-VolumesTransfersV357Test-1243990894 None] Created volume successfully. Aug 26 12:06:52 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16" returned: 0 in 0.539s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:53 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16 Aug 26 12:06:53 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:53 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16" returned: 0 in 0.324s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Lock "cinder-quobyte-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16" released by "delete_volume" :: held 0.926s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:53 devstack cinder-volume[94387]: WARNING cinder.quota [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1034164216 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1034164216, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:06:53 devstack cinder-volume[94387]: WARNING cinder.quota [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1034164216 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1034164216, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:06:53 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Created reservations ['01680330-2125-4692-9c98-5f8bcb45acc8', '1a2b7b7e-1053-4342-ad15-08bbcf87e399', '46c5348a-3079-490a-8c5b-9cc9f29a7f2b', 'd55e18bf-8665-4c4b-b56f-e9ae94fa3065'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:53 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:53 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:54 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.638s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:54 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:54 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Deleted volume successfully. Aug 26 12:06:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fee31d2f-7be8-4bcc-9c9c-e14c91c06df3 tempest-VolumeTypesAccessTest-165934211 None] Lock "cinder-f1569cfe-f18f-4b1b-a8cf-586ecdcfbd16-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Acquiring lock "cinder-b9457be5-4b5a-47f6-9905-3309665fed1e-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Lock "cinder-b9457be5-4b5a-47f6-9905-3309665fed1e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Acquiring lock "cinder-quobyte-b9457be5-4b5a-47f6-9905-3309665fed1e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Lock "cinder-quobyte-b9457be5-4b5a-47f6-9905-3309665fed1e" acquired by "delete_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:54 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f06fa89-4aee-4392-a3fa-12bf7442ebba]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:06:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:54 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e Aug 26 12:06:54 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:55 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e" returned: 0 in 0.752s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:55 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e Aug 26 12:06:55 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:55 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b9457be5-4b5a-47f6-9905-3309665fed1e" returned: 0 in 0.616s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:55 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Lock "cinder-quobyte-b9457be5-4b5a-47f6-9905-3309665fed1e" released by "delete_volume" :: held 1.453s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Created reservations ['7719ca68-7538-49e1-9ee8-fb9e30a60fb7', '02664ce6-22a6-4038-a5f2-0ed54dfa48cd', 'eead74f5-f5c1-472b-8bdc-b87444a07719', 'bb09ac6a-3eca-4945-8abb-197caa4278ef'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:56 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:06:56 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (1824ff79-e7e8-4266-9813-6ef90eb787cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b82a7c-95ff-4efa-a48a-a3c14a0fc56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b82a7c-95ff-4efa-a48a-a3c14a0fc56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1595392172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e9d47d-95bf-4b89-aff7-492910a0abe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:57Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581127f5-43b7-4ef7-a86f-005081c6f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581127f5-43b7-4ef7-a86f-005081c6f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18dcdd06-e37c-4be8-a647-88495b435b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18dcdd06-e37c-4be8-a647-88495b435b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16e9d47d-95bf-4b89-aff7-492910a0abe1', 'volume_name': 'volume-16e9d47d-95bf-4b89-aff7-492910a0abe1', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53795f7a-6451-4d59-8d27-882a17f2af7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53795f7a-6451-4d59-8d27-882a17f2af7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b88a6ad-5c79-426e-a756-c4a8af7dc850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:56 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Volume 16e9d47d-95bf-4b89-aff7-492910a0abe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16e9d47d-95bf-4b89-aff7-492910a0abe1', 'volume_size': 1} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1595392172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e9d47d-95bf-4b89-aff7-492910a0abe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:06:57Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Creating volume 16e9d47d-95bf-4b89-aff7-492910a0abe1 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:06:56 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:56 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:56 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 1073741824 Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.479s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:56 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:06:56 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Deleted volume successfully. Aug 26 12:06:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1fd56d59-c9dd-468b-9882-faeb4d2f7e61 tempest-VolumesTransfersV357Test-1897037720 None] Lock "cinder-b9457be5-4b5a-47f6-9905-3309665fed1e-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:57 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 1073741824" returned: 0 in 0.738s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:06:57 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 Aug 26 12:06:57 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:06:58 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1" returned: 0 in 0.416s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b88a6ad-5c79-426e-a756-c4a8af7dc850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e9d47d-95bf-4b89-aff7-492910a0abe1', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b57f4ef-a16a-46a4-9c2a-17828fa3dcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:06:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Volume volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 (16e9d47d-95bf-4b89-aff7-492910a0abe1): created successfully Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b57f4ef-a16a-46a4-9c2a-17828fa3dcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (1824ff79-e7e8-4266-9813-6ef90eb787cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:06:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b4f85896-d89f-4c27-bff7-87b99f8b92e7 tempest-VolumesActionsTest-2133184747 None] Created volume successfully. Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4fe0fbda-a3a0-4ef5-b312-1f96e1e150de tempest-VolumesActionsTest-2133184747 None] Acquiring lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1" by "attach_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4fe0fbda-a3a0-4ef5-b312-1f96e1e150de tempest-VolumesActionsTest-2133184747 None] Lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1" acquired by "attach_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:06:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4fe0fbda-a3a0-4ef5-b312-1f96e1e150de tempest-VolumesActionsTest-2133184747 None] Attaching volume 16e9d47d-95bf-4b89-aff7-492910a0abe1 to instance 662d5004-179c-4ba9-939e-0f318f97cb93 at mountpoint /dev/vdb on host None. Aug 26 12:06:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4fe0fbda-a3a0-4ef5-b312-1f96e1e150de tempest-VolumesActionsTest-2133184747 None] Attach volume completed successfully. Aug 26 12:06:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4fe0fbda-a3a0-4ef5-b312-1f96e1e150de tempest-VolumesActionsTest-2133184747 None] Lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1" released by "attach_volume" :: held 0.144s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:06:59 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2a4d6d58-029b-4efc-a501-233ee157bf3c tempest-VolumesActionsTest-1982233667 None] Terminate volume connection completed successfully. Aug 26 12:07:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2a4d6d58-029b-4efc-a501-233ee157bf3c tempest-VolumesActionsTest-1982233667 None] Acquiring lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1-detach_volume" by "detach_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2a4d6d58-029b-4efc-a501-233ee157bf3c tempest-VolumesActionsTest-1982233667 None] Lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2a4d6d58-029b-4efc-a501-233ee157bf3c tempest-VolumesActionsTest-1982233667 None] Detaching volume 16e9d47d-95bf-4b89-aff7-492910a0abe1 from instance 662d5004-179c-4ba9-939e-0f318f97cb93. Aug 26 12:07:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2a4d6d58-029b-4efc-a501-233ee157bf3c tempest-VolumesActionsTest-1982233667 None] Detach volume completed successfully. Aug 26 12:07:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2a4d6d58-029b-4efc-a501-233ee157bf3c tempest-VolumesActionsTest-1982233667 None] Lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-512092af-51ea-4810-ac2d-f51375a2bcfe tempest-VolumesActionsTest-2133184747 None] Acquiring lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1-detach_volume" by "detach_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-512092af-51ea-4810-ac2d-f51375a2bcfe tempest-VolumesActionsTest-2133184747 None] Lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-512092af-51ea-4810-ac2d-f51375a2bcfe tempest-VolumesActionsTest-2133184747 None] Volume detach called, but volume not attached. Aug 26 12:07:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-512092af-51ea-4810-ac2d-f51375a2bcfe tempest-VolumesActionsTest-2133184747 None] Lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "cinder-quobyte-16e9d47d-95bf-4b89-aff7-492910a0abe1" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Lock "cinder-quobyte-16e9d47d-95bf-4b89-aff7-492910a0abe1" acquired by "delete_volume" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:01 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[77db7b8c-8c87-46fc-b258-ed9e48208a63]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:01 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 Aug 26 12:07:01 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:01 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1" returned: 0 in 0.578s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:01 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1 Aug 26 12:07:01 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:02 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16e9d47d-95bf-4b89-aff7-492910a0abe1" returned: 0 in 0.530s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Lock "cinder-quobyte-16e9d47d-95bf-4b89-aff7-492910a0abe1" released by "delete_volume" :: held 1.188s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:02 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Created reservations ['d6af65c9-f4dd-4a5e-b354-802f9122eebf', '8684f865-f51b-4468-808c-6c54bc1ba2ee', '8328658e-4104-45d4-8f12-45d496a54c63', 'cc368329-2108-41e6-a7ee-95b717dc6ec1'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:02 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:02 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:03 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.432s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:03 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:03 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Deleted volume successfully. Aug 26 12:07:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6ee06003-a9a0-4fad-b975-de962061c892 tempest-VolumesActionsTest-2133184747 None] Lock "cinder-16e9d47d-95bf-4b89-aff7-492910a0abe1-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (593c3d73-ddc0-4e5a-88b5-6398e3b02819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684f9e9a-add5-4c27-ae96-15fc6c5ee539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684f9e9a-add5-4c27-ae96-15fc6c5ee539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607160713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46026f2-29d9-46c0-ab76-88d24517f675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:07Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f48700-03d4-4459-b4ae-b24e02fe274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f48700-03d4-4459-b4ae-b24e02fe274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e833a724-bf07-497a-9cc0-b5038c5950be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e833a724-bf07-497a-9cc0-b5038c5950be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46026f2-29d9-46c0-ab76-88d24517f675', 'volume_name': 'volume-a46026f2-29d9-46c0-ab76-88d24517f675', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5a1a6f-cda0-4e53-8747-04e1b4a0e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5a1a6f-cda0-4e53-8747-04e1b4a0e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce741b4e-2347-4d5e-a823-59c6628cca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Volume a46026f2-29d9-46c0-ab76-88d24517f675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46026f2-29d9-46c0-ab76-88d24517f675', 'volume_size': 1} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607160713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46026f2-29d9-46c0-ab76-88d24517f675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:07Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Creating volume a46026f2-29d9-46c0-ab76-88d24517f675 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:07 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:07 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675 1073741824 Aug 26 12:07:07 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Flow 'volume_create_manager' (c45fdb84-66c8-443d-a39a-4d1a7d436996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe907f9-7322-4c06-85b4-4e5a8ccdda65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe907f9-7322-4c06-85b4-4e5a8ccdda65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1220532736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393d5dec-59b5-487d-bf99-7345406469cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee84566a443b4e3e8778555b6461ee2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:08Z,use_quota=True,user_id='aa5a17bff6e5424eb49bb96b62aa7b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946c77cd-7654-480c-97f4-2d12492331c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946c77cd-7654-480c-97f4-2d12492331c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8296f3b0-a8b8-4ac4-b545-f3c718c5b8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8296f3b0-a8b8-4ac4-b545-f3c718c5b8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393d5dec-59b5-487d-bf99-7345406469cd', 'volume_name': 'volume-393d5dec-59b5-487d-bf99-7345406469cd', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c352fdef-a6c0-4ac8-8a21-22ca05832b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c352fdef-a6c0-4ac8-8a21-22ca05832b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f8f09b-50e1-4274-b7c2-b0bce4ad1947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:07 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Volume 393d5dec-59b5-487d-bf99-7345406469cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393d5dec-59b5-487d-bf99-7345406469cd', 'volume_size': 1} Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:07 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675 1073741824" returned: 0 in 0.582s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:08 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675 Aug 26 12:07:08 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:08 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675" returned: 0 in 0.312s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1220532736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393d5dec-59b5-487d-bf99-7345406469cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee84566a443b4e3e8778555b6461ee2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:08Z,use_quota=True,user_id='aa5a17bff6e5424eb49bb96b62aa7b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Creating volume 393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:08 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce741b4e-2347-4d5e-a823-59c6628cca14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46026f2-29d9-46c0-ab76-88d24517f675', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:08 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd 1073741824 Aug 26 12:07:08 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec784f0-916b-4a73-9448-ef4e88f585ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:08 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Volume volume-a46026f2-29d9-46c0-ab76-88d24517f675 (a46026f2-29d9-46c0-ab76-88d24517f675): created successfully Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec784f0-916b-4a73-9448-ef4e88f585ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (593c3d73-ddc0-4e5a-88b5-6398e3b02819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:08 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2ea6321d-39f2-492f-bf38-6235831fa3e7 tempest-VolumesActionsTest-2133184747 None] Created volume successfully. Aug 26 12:07:08 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd 1073741824" returned: 0 in 0.560s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=121,cinder:UPDATE=158,cinder:INSERT=28,cinder:DELETE=9 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:07:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:08 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd Aug 26 12:07:08 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:09 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd" returned: 0 in 0.306s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f8f09b-50e1-4274-b7c2-b0bce4ad1947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393d5dec-59b5-487d-bf99-7345406469cd', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160e2990-538f-4f1c-8824-2869b25d8bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:09 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Volume volume-393d5dec-59b5-487d-bf99-7345406469cd (393d5dec-59b5-487d-bf99-7345406469cd): created successfully Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160e2990-538f-4f1c-8824-2869b25d8bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Flow 'volume_create_manager' (c45fdb84-66c8-443d-a39a-4d1a7d436996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:09 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-343bcc52-12e6-402b-831a-9096109f306f tempest-VolumesCloneTest-1514213562 None] Created volume successfully. Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Acquiring lock "cinder-a46026f2-29d9-46c0-ab76-88d24517f675-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Lock "cinder-a46026f2-29d9-46c0-ab76-88d24517f675-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Acquiring lock "cinder-quobyte-a46026f2-29d9-46c0-ab76-88d24517f675" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Lock "cinder-quobyte-a46026f2-29d9-46c0-ab76-88d24517f675" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d721a66-200f-465b-9c98-db37d7afd1d4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:09 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675 Aug 26 12:07:09 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:10 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675" returned: 0 in 0.546s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:10 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675 Aug 26 12:07:10 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=123,cinder:UPDATE=154,cinder:INSERT=41,cinder:DELETE=12 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Flow 'volume_create_manager' (68f20d91-ae5d-4ec9-baf8-9de431121bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151fb763-645d-4431-9361-514d7a57dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151fb763-645d-4431-9361-514d7a57dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-818531544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035523db-e887-43a3-b1a5-929a4b2fcbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee84566a443b4e3e8778555b6461ee2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=393d5dec-59b5-487d-bf99-7345406469cd,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:10Z,use_quota=True,user_id='aa5a17bff6e5424eb49bb96b62aa7b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52521a5f-4582-414a-897e-b55e46913d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52521a5f-4582-414a-897e-b55e46913d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb6031d-ee12-471a-b10c-8b4c9457cc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb6031d-ee12-471a-b10c-8b4c9457cc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '035523db-e887-43a3-b1a5-929a4b2fcbea', 'volume_name': 'volume-035523db-e887-43a3-b1a5-929a4b2fcbea', 'volume_size': 2, 'source_volid': '393d5dec-59b5-487d-bf99-7345406469cd', 'source_volstatus': 'available'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2642813f-f83d-43dc-9775-1f8309e91f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2642813f-f83d-43dc-9775-1f8309e91f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd06da4-668d-4033-9715-8530ed01978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:10 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Volume 035523db-e887-43a3-b1a5-929a4b2fcbea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-035523db-e887-43a3-b1a5-929a4b2fcbea', 'volume_size': 2, 'source_volid': '393d5dec-59b5-487d-bf99-7345406469cd', 'source_volstatus': 'available'} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:10 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Cloning volume 393d5dec-59b5-487d-bf99-7345406469cd to volume 035523db-e887-43a3-b1a5-929a4b2fcbea Aug 26 12:07:10 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:10 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:10 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Creating offline snapshot 53ce432d-8ea5-4d86-8b58-938550ee6b3a of volume 393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a46026f2-29d9-46c0-ab76-88d24517f675" returned: 0 in 0.399s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Lock "cinder-quobyte-a46026f2-29d9-46c0-ab76-88d24517f675" released by "delete_volume" :: held 1.014s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c49779-0b19-4a9e-9fba-c768e6836a29]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Created reservations ['d727e3c7-b6e1-484a-bf57-b9a430f06f98', 'd0514f7e-e7d2-4448-8e74-376d4e88dad1', '24768782-1d68-45ef-ad67-731e5642572d', 'adaaf333-d2f3-485c-882a-194230f68396'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:10 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd Aug 26 12:07:10 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:10 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:10 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:10 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.437s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:07:11 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd" returned: 0 in 0.522s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:11 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a 1G Aug 26 12:07:11 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:11 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.376s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:11 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Deleted volume successfully. Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0c88dc0b-a708-4e86-bd5e-86d67efe651a tempest-VolumesActionsTest-1982233667 None] Lock "cinder-a46026f2-29d9-46c0-ab76-88d24517f675-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:11 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a 1G" returned: 0 in 0.509s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-393d5dec-59b5-487d-bf99-7345406469cd -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:11 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-393d5dec-59b5-487d-bf99-7345406469cd -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a Aug 26 12:07:11 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:12 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-393d5dec-59b5-487d-bf99-7345406469cd -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a" returned: 0 in 0.340s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:12 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a is being set with open permissions: ugo+rw Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:12 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a Aug 26 12:07:12 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:12 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a" returned: 0 in 0.390s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (3d79f09e-a68e-4d37-9cbb-15b6f311d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adb0a9e-dd18-42c7-a2cf-a80532564187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adb0a9e-dd18-42c7-a2cf-a80532564187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-188488183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72dd94fe-1c41-496b-804e-9c85c6913aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:12Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2aa548-3936-403d-ac15-ebf1f12acf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2aa548-3936-403d-ac15-ebf1f12acf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad4b5ff-3c52-477f-a54a-f2105a343e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad4b5ff-3c52-477f-a54a-f2105a343e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72dd94fe-1c41-496b-804e-9c85c6913aa9', 'volume_name': 'volume-72dd94fe-1c41-496b-804e-9c85c6913aa9', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7279005f-4c25-45b1-a392-f4ebeadb77d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7279005f-4c25-45b1-a392-f4ebeadb77d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c8e07c-d1d7-466e-9e17-964856d31f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:12 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Volume 72dd94fe-1c41-496b-804e-9c85c6913aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72dd94fe-1c41-496b-804e-9c85c6913aa9', 'volume_size': 1} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:12 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.info Aug 26 12:07:12 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:12 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.info" returned: 0 in 0.280s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:12 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.info is being set with open permissions: ugo+rw Aug 26 12:07:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:12 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.info Aug 26 12:07:12 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:13 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.info" returned: 0 in 0.297s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Acquiring lock "cinder-quobyte-035523db-e887-43a3-b1a5-929a4b2fcbea" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Lock "cinder-quobyte-035523db-e887-43a3-b1a5-929a4b2fcbea" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] snapshot: 53ce432d-8ea5-4d86-8b58-938550ee6b3a, volume: 035523db-e887-43a3-b1a5-929a4b2fcbea, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbf7335-a083-45e4-a785-03d30870f919]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:13 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a Aug 26 12:07:13 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:13 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a" returned: 0 in 0.440s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-393d5dec-59b5-487d-bf99-7345406469cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[6900fef1-1ae6-4082-8428-74946cbcc9c3]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:13 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd Aug 26 12:07:13 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Flow 'volume_create_manager' (f03a6de9-306a-401e-be3d-85bd9088f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910dbcf4-1cc4-4573-a6a9-54fa12d3e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910dbcf4-1cc4-4573-a6a9-54fa12d3e22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1975022414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd3f301-382c-4c87-af91-200e8931d19e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16820cf30ba44e4a2c75dbbd6787690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:14Z,use_quota=True,user_id='1262c0e7b8154b97b286d5ec8ec30a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829cbd22-6196-45d8-89a1-616940e98721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829cbd22-6196-45d8-89a1-616940e98721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f7d25c-ddc9-4118-89f7-3cf3878d3a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:07:14 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd" returned: 0 in 0.455s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:14 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea Aug 26 12:07:14 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f7d25c-ddc9-4118-89f7-3cf3878d3a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfd3f301-382c-4c87-af91-200e8931d19e', 'volume_name': 'volume-cfd3f301-382c-4c87-af91-200e8931d19e', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c49123-426d-4de5-8d48-87356e340bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c49123-426d-4de5-8d48-87356e340bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f64ca2-73e0-4e37-a74b-ea099403a648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:14 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Volume cfd3f301-382c-4c87-af91-200e8931d19e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfd3f301-382c-4c87-af91-200e8931d19e', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Trying to clone cfd3f301-382c-4c87-af91-200e8931d19e from image 014b1010-45ca-42a7-a54b-7655e36f8066 at location (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:07:14 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Image download 20.69 MB at 20.69 MB/s Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c48923-b2de-481d-bd4b-cca1a9b005ed]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:15 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD Aug 26 12:07:15 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:15 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD" returned: 0 in 0.954s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:15 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 is fetched for user 1262c0e7b8154b97b286d5ec8ec30a9b. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:07:16 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[92200e11-d1ff-4ee2-ad11-e4235114c267]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:16 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD Aug 26 12:07:16 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:16 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea" returned: 0 in 5.162s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:07:19 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Converted 1024.00 MB image at 198.32 MB/s Aug 26 12:07:19 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea is being set with open permissions: ugo+rw Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:19 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea Aug 26 12:07:19 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:19 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea" returned: 0 in 0.251s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Lock "cinder-quobyte-035523db-e887-43a3-b1a5-929a4b2fcbea" released by "_copy_volume_from_snapshot" :: held 6.399s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Acquiring lock "cinder-quobyte-53ce432d-8ea5-4d86-8b58-938550ee6b3a" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Lock "cinder-quobyte-53ce432d-8ea5-4d86-8b58-938550ee6b3a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Deleting offline snapshot 53ce432d-8ea5-4d86-8b58-938550ee6b3a of volume 393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] snapshot_file for this snap is: volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0810c49-f308-4dc4-bd41-f7ec4602da58]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:19 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a Aug 26 12:07:19 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:20 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a" returned: 0 in 0.367s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-393d5dec-59b5-487d-bf99-7345406469cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:07:20 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65bdb60-9489-4196-b335-6c182bf8afab]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:20 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd Aug 26 12:07:20 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:20 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd" returned: 0 in 0.515s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:20 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a Aug 26 12:07:20 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:20 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a" returned: 0 in 0.351s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:20 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a Aug 26 12:07:20 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:21 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd.53ce432d-8ea5-4d86-8b58-938550ee6b3a" returned: 0 in 0.277s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Lock "cinder-quobyte-53ce432d-8ea5-4d86-8b58-938550ee6b3a" released by "_delete_snapshot" :: held 1.607s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.713s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.709s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-188488183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72dd94fe-1c41-496b-804e-9c85c6913aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:12Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Creating volume 72dd94fe-1c41-496b-804e-9c85c6913aa9 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:21 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:21 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 1073741824 Aug 26 12:07:21 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd06da4-668d-4033-9715-8530ed01978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035523db-e887-43a3-b1a5-929a4b2fcbea', 'volume_size': 2, 'source_volid': '393d5dec-59b5-487d-bf99-7345406469cd', 'source_volstatus': 'available'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54fab7a-54a6-48c6-bdea-02464748b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:21 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Volume volume-035523db-e887-43a3-b1a5-929a4b2fcbea (035523db-e887-43a3-b1a5-929a4b2fcbea): created successfully Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54fab7a-54a6-48c6-bdea-02464748b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Flow 'volume_create_manager' (68f20d91-ae5d-4ec9-baf8-9de431121bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-61b3d7c9-c9ec-4f2c-aa9e-1cb99af463f0 tempest-VolumesCloneTest-1514213562 None] Created volume successfully. Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Acquiring lock "cinder-035523db-e887-43a3-b1a5-929a4b2fcbea-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Lock "cinder-035523db-e887-43a3-b1a5-929a4b2fcbea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:21 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 1073741824" returned: 0 in 0.576s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Acquiring lock "cinder-quobyte-035523db-e887-43a3-b1a5-929a4b2fcbea" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Lock "cinder-quobyte-035523db-e887-43a3-b1a5-929a4b2fcbea" acquired by "delete_volume" :: waited 0.047s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:21 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 Aug 26 12:07:21 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[070590af-4b78-4748-b364-0509b53951ea]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:22 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea Aug 26 12:07:22 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:22 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9" returned: 0 in 0.286s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.543s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1975022414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd3f301-382c-4c87-af91-200e8931d19e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16820cf30ba44e4a2c75dbbd6787690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:14Z,use_quota=True,user_id='1262c0e7b8154b97b286d5ec8ec30a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Creating volume cfd3f301-382c-4c87-af91-200e8931d19e {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:22 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c8e07c-d1d7-466e-9e17-964856d31f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72dd94fe-1c41-496b-804e-9c85c6913aa9', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99feb737-ec69-4135-b7e6-234f7d0a6b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:22 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e 1073741824 Aug 26 12:07:22 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:22 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Volume volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 (72dd94fe-1c41-496b-804e-9c85c6913aa9): created successfully Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99feb737-ec69-4135-b7e6-234f7d0a6b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (3d79f09e-a68e-4d37-9cbb-15b6f311d241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:22 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-27353509-78a6-4470-9337-cad0f2f6474a tempest-VolumesActionsTest-2133184747 None] Created volume successfully. Aug 26 12:07:22 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea" returned: 0 in 0.425s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:22 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea Aug 26 12:07:22 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:22 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-035523db-e887-43a3-b1a5-929a4b2fcbea" returned: 0 in 0.292s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Lock "cinder-quobyte-035523db-e887-43a3-b1a5-929a4b2fcbea" released by "delete_volume" :: held 0.778s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Created reservations ['4f05cf91-b99d-48d5-95fb-e2ff46a69aba', '98ad572d-a674-4301-936c-4e83b69cdbd4', '90f48b77-2ba4-4a4c-8d01-80e0e9cf56f7', 'd90e45b0-38de-4e82-aea0-87f28ec5f72b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:22 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e 1073741824" returned: 0 in 0.554s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:22 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e Aug 26 12:07:22 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:22 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:22 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Acquiring lock "cinder-72dd94fe-1c41-496b-804e-9c85c6913aa9-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Lock "cinder-72dd94fe-1c41-496b-804e-9c85c6913aa9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Acquiring lock "cinder-quobyte-72dd94fe-1c41-496b-804e-9c85c6913aa9" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Acquiring lock "cinder-393d5dec-59b5-487d-bf99-7345406469cd-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Lock "cinder-quobyte-72dd94fe-1c41-496b-804e-9c85c6913aa9" acquired by "delete_volume" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:23 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:23 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Lock "cinder-393d5dec-59b5-487d-bf99-7345406469cd-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.367s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e" returned: 0 in 0.435s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07ea2ab-57f6-430c-8b14-535fa441ab68]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Deleted volume successfully. Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02374f15-ba88-45a5-b606-4924f7c8673d tempest-VolumesCloneTest-1514213562 None] Lock "cinder-035523db-e887-43a3-b1a5-929a4b2fcbea-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Attempting download of 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume cfd3f301-382c-4c87-af91-200e8931d19e. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Acquiring lock "cinder-quobyte-393d5dec-59b5-487d-bf99-7345406469cd" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Lock "cinder-quobyte-393d5dec-59b5-487d-bf99-7345406469cd" acquired by "delete_volume" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:23 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 Aug 26 12:07:23 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[da942289-9cec-420d-9ac6-1a74c449b68b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[be485889-f33f-4afb-b692-9e07932f0669]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_9hf96rdy {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:23 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd Aug 26 12:07:23 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:23 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_9hf96rdy Aug 26 12:07:23 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:23 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9" returned: 0 in 0.444s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:23 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9 Aug 26 12:07:23 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:23 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_9hf96rdy" returned: 0 in 0.383s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_9hf96rdy {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:23 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd" returned: 0 in 0.442s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:23 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd Aug 26 12:07:23 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:23 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_9hf96rdy Aug 26 12:07:23 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:24 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-72dd94fe-1c41-496b-804e-9c85c6913aa9" returned: 0 in 0.288s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Lock "cinder-quobyte-72dd94fe-1c41-496b-804e-9c85c6913aa9" released by "delete_volume" :: held 0.822s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Created reservations ['cd97edcb-fcc6-4715-b05c-26dbce094653', '038673fa-395c-4365-98fc-25d37a0e92ab', '97df1fce-ff63-41af-8a31-835205005e07', 'e335d994-70a1-4abc-8328-d24774c48e24'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:24 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-393d5dec-59b5-487d-bf99-7345406469cd" returned: 0 in 0.388s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:24 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:24 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:24 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_9hf96rdy" returned: 1 in 0.449s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_9hf96rdy' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[56698f0e-624e-4721-a555-5418056b7fd7]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Lock "cinder-quobyte-393d5dec-59b5-487d-bf99-7345406469cd" released by "delete_volume" :: held 0.947s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Created reservations ['0f985e3b-7c6f-4ad8-b4d6-e70fc740784d', 'c3cf5739-478a-4185-8437-cff42b4372df', 'e6fd6b20-2b12-4122-8333-9411ccfeaa57', '9be54e4b-5dc5-4c92-9815-155865f7f69f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:24 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD Aug 26 12:07:24 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:24 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.359s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:24 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Deleted volume successfully. Aug 26 12:07:24 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:24 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efe4bbeb-66c9-4258-b114-942cc4d5666f tempest-VolumesActionsTest-1982233667 None] Lock "cinder-72dd94fe-1c41-496b-804e-9c85c6913aa9-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:24 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD" returned: 0 in 0.586s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] 014b1010-45ca-42a7-a54b-7655e36f8066 was qcow2, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:07:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:24 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e Aug 26 12:07:24 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (854c5a62-a37c-4b6b-a9da-82f46dba63f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05332db2-6600-4e0e-8b27-32d3f7406c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:25 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.507s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Deleted volume successfully. Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05332db2-6600-4e0e-8b27-32d3f7406c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840540030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8bacc7-0d0d-4a54-b74f-b58241a36f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:25Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da251922-0ff5-4502-9ae4-ab2577dccd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da251922-0ff5-4502-9ae4-ab2577dccd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9a2a51-8ab9-4b9e-bc9a-f73fc52865ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9a2a51-8ab9-4b9e-bc9a-f73fc52865ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8bacc7-0d0d-4a54-b74f-b58241a36f11', 'volume_name': 'volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbbbc38-1aa1-449f-af38-d400893a3a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbbbc38-1aa1-449f-af38-d400893a3a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d341d9-6315-46e0-8db4-de5911071b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:25 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Volume be8bacc7-0d0d-4a54-b74f-b58241a36f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11', 'volume_size': 1} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840540030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8bacc7-0d0d-4a54-b74f-b58241a36f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:25Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Creating volume be8bacc7-0d0d-4a54-b74f-b58241a36f11 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:25 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:25 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 1073741824 Aug 26 12:07:25 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc6681ef-3c02-4cad-8019-5990532da0c8 tempest-VolumesCloneTest-1514213562 None] Lock "cinder-393d5dec-59b5-487d-bf99-7345406469cd-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:25 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 1073741824" returned: 0 in 0.577s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:25 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 Aug 26 12:07:25 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:26 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11" returned: 0 in 0.313s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d341d9-6315-46e0-8db4-de5911071b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6c97a4-948f-4730-8ae2-76a90a2fad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:26 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Volume volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 (be8bacc7-0d0d-4a54-b74f-b58241a36f11): created successfully Aug 26 12:07:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6c97a4-948f-4730-8ae2-76a90a2fad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (854c5a62-a37c-4b6b-a9da-82f46dba63f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:26 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2c7183f8-b926-4970-9004-d2d448c49ff6 tempest-VolumesActionsTest-2133184747 None] Created volume successfully. Aug 26 12:07:27 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e" returned: 0 in 2.231s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_tmne_n1edevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:07:27 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Converted 112.00 MB image at 50.18 MB/s Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:27 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e 1G Aug 26 12:07:27 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Acquiring lock "cinder-be8bacc7-0d0d-4a54-b74f-b58241a36f11-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Lock "cinder-be8bacc7-0d0d-4a54-b74f-b58241a36f11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Acquiring lock "cinder-quobyte-be8bacc7-0d0d-4a54-b74f-b58241a36f11" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Lock "cinder-quobyte-be8bacc7-0d0d-4a54-b74f-b58241a36f11" acquired by "delete_volume" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a3016b-f3fb-403e-93d0-9102a6f2353e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:27 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e 1G" returned: 0 in 0.438s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Downloaded image 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume cfd3f301-382c-4c87-af91-200e8931d19e successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 for user 1262c0e7b8154b97b286d5ec8ec30a9b is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Marking volume cfd3f301-382c-4c87-af91-200e8931d19e as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Copying metadata from image 014b1010-45ca-42a7-a54b-7655e36f8066 to cfd3f301-382c-4c87-af91-200e8931d19e. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Creating volume glance metadata for volume cfd3f301-382c-4c87-af91-200e8931d19e backed by image 014b1010-45ca-42a7-a54b-7655e36f8066 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:07:27 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 Aug 26 12:07:27 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f64ca2-73e0-4e37-a74b-ea099403a648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd3f301-382c-4c87-af91-200e8931d19e', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676bb46d-e1ad-437e-86be-2886e9b97ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:27 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Volume volume-cfd3f301-382c-4c87-af91-200e8931d19e (cfd3f301-382c-4c87-af91-200e8931d19e): created successfully Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676bb46d-e1ad-437e-86be-2886e9b97ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Flow 'volume_create_manager' (f03a6de9-306a-401e-be3d-85bd9088f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c87d4efc-a029-4b9b-ba3a-0002d9aa09e2 tempest-VolumesImageMetadata-473400010 None] Created volume successfully. Aug 26 12:07:27 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11" returned: 0 in 0.450s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:28 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11 Aug 26 12:07:28 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:28 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be8bacc7-0d0d-4a54-b74f-b58241a36f11" returned: 0 in 0.300s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Lock "cinder-quobyte-be8bacc7-0d0d-4a54-b74f-b58241a36f11" released by "delete_volume" :: held 0.798s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Created reservations ['ed2d2e83-d00a-4471-b198-37807dcddbda', 'bf134834-3c8e-4254-bb8d-e94d57c50d23', '67913ed2-49cb-45c7-a820-1b13e486ff98', 'c3e43081-c588-45f8-abf6-35fb6f1e8782'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:28 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:28 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Flow 'volume_create_manager' (44f48744-3ed4-4b69-8581-e7f0261a839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99383b5a-cfa0-451d-b3de-ebac398d5514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99383b5a-cfa0-451d-b3de-ebac398d5514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-949431609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a257a823-b441-4ece-a8af-973469e2491d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b7023ea24d45a98a803126a094afda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:29Z,use_quota=True,user_id='029e28196d564e1e9b198840b2b317aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5aae2f4-43cb-4c0f-a431-aa0b892e0cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5aae2f4-43cb-4c0f-a431-aa0b892e0cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44e7a54-5369-4db0-bf79-9e4dcecf6d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44e7a54-5369-4db0-bf79-9e4dcecf6d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a257a823-b441-4ece-a8af-973469e2491d', 'volume_name': 'volume-a257a823-b441-4ece-a8af-973469e2491d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8278e7c-7758-4044-8544-b20743481ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8278e7c-7758-4044-8544-b20743481ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf548236-0055-41d6-87db-af33789b306f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:28 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Volume a257a823-b441-4ece-a8af-973469e2491d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a257a823-b441-4ece-a8af-973469e2491d', 'volume_size': 1} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-949431609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a257a823-b441-4ece-a8af-973469e2491d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b7023ea24d45a98a803126a094afda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:29Z,use_quota=True,user_id='029e28196d564e1e9b198840b2b317aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Creating volume a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:28 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:28 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d 1073741824 Aug 26 12:07:28 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:28 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.300s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Deleted volume successfully. Aug 26 12:07:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-74594931-53f9-42a9-9c8c-0c20aabe2d28 tempest-VolumesActionsTest-1982233667 None] Lock "cinder-be8bacc7-0d0d-4a54-b74f-b58241a36f11-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Acquiring lock "cinder-cfd3f301-382c-4c87-af91-200e8931d19e-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Lock "cinder-cfd3f301-382c-4c87-af91-200e8931d19e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:29 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d 1073741824" returned: 0 in 0.618s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Acquiring lock "cinder-quobyte-cfd3f301-382c-4c87-af91-200e8931d19e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Lock "cinder-quobyte-cfd3f301-382c-4c87-af91-200e8931d19e" acquired by "delete_volume" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:29 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d Aug 26 12:07:29 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ce45c2-6144-4ff5-9c8a-8d29d70a2abb]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Flow 'volume_create_manager' (76403c28-02a1-4c9b-8a41-c9efb465ab7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc18f0e6-d6f2-4130-913d-6ae843585e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e Aug 26 12:07:29 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc18f0e6-d6f2-4130-913d-6ae843585e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-655265327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a85c60-c4b5-4ae6-8a26-7917b29b9d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f40d7071e1c4c19a39b3ab0a37b3df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:29Z,use_quota=True,user_id='88720f1bddc74e7980c82a2e2eed982e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a6d857-9596-40d5-971b-1e0ec23db33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a6d857-9596-40d5-971b-1e0ec23db33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b9ce8c-ef83-4ffe-b7f7-4492c2269f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b9ce8c-ef83-4ffe-b7f7-4492c2269f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a85c60-c4b5-4ae6-8a26-7917b29b9d16', 'volume_name': 'volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16', 'volume_size': 2}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78102bdc-903b-47b2-a82a-e9e12c1e7cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78102bdc-903b-47b2-a82a-e9e12c1e7cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbee809b-afc9-4f70-87e7-01dbd9101080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Volume 18a85c60-c4b5-4ae6-8a26-7917b29b9d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16', 'volume_size': 2} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:29 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-655265327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a85c60-c4b5-4ae6-8a26-7917b29b9d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f40d7071e1c4c19a39b3ab0a37b3df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:29Z,use_quota=True,user_id='88720f1bddc74e7980c82a2e2eed982e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Creating volume 18a85c60-c4b5-4ae6-8a26-7917b29b9d16 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:29 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 2147483648 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:29 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 2147483648 Aug 26 12:07:29 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (72accf56-583c-4911-82ae-e3402e27df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879b099a-c5ee-4064-9f69-003ed7018621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf548236-0055-41d6-87db-af33789b306f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a257a823-b441-4ece-a8af-973469e2491d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da81ea9f-dccb-4e85-9b2d-14c7f3df0b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879b099a-c5ee-4064-9f69-003ed7018621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1609143028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b48461f-52e7-49b6-83f1-3190fb178717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:30Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339d5316-f123-4477-bbf8-36c5e00b528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339d5316-f123-4477-bbf8-36c5e00b528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8101e7d0-5230-4161-a902-e8d188a151dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8101e7d0-5230-4161-a902-e8d188a151dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b48461f-52e7-49b6-83f1-3190fb178717', 'volume_name': 'volume-0b48461f-52e7-49b6-83f1-3190fb178717', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a590092d-fa61-48de-aed3-cd1402ea63fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a590092d-fa61-48de-aed3-cd1402ea63fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589e7f37-3808-4fc0-9166-3d92dd5e4722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:29 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Volume 0b48461f-52e7-49b6-83f1-3190fb178717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b48461f-52e7-49b6-83f1-3190fb178717', 'volume_size': 1} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:29 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Volume volume-a257a823-b441-4ece-a8af-973469e2491d (a257a823-b441-4ece-a8af-973469e2491d): created successfully Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da81ea9f-dccb-4e85-9b2d-14c7f3df0b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Flow 'volume_create_manager' (44f48744-3ed4-4b69-8581-e7f0261a839b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:29 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-40257065-c1b5-414d-934d-f900eb86a76c tempest-VolumesDeleteCascade-1365158057 None] Created volume successfully. Aug 26 12:07:29 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e" returned: 0 in 0.434s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:29 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e Aug 26 12:07:29 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:30 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfd3f301-382c-4c87-af91-200e8931d19e" returned: 0 in 0.275s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Lock "cinder-quobyte-cfd3f301-382c-4c87-af91-200e8931d19e" released by "delete_volume" :: held 0.756s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:30 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 2147483648" returned: 0 in 0.521s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Created reservations ['9cb421d8-2ce5-4938-8e70-a02523bb0478', '332d754c-6d99-4b3e-8805-c5155d94b0fc', '530e092f-892d-41f8-bd57-b65638d48cc5', 'cabf6a16-f1bc-4d9a-aef3-f231ac1307f6'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:30 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 Aug 26 12:07:30 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:30 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:30 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:30 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16" returned: 0 in 0.272s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1609143028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b48461f-52e7-49b6-83f1-3190fb178717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:30Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Creating volume 0b48461f-52e7-49b6-83f1-3190fb178717 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:30 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbee809b-afc9-4f70-87e7-01dbd9101080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16', 'volume_size': 2}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:30 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717 1073741824 Aug 26 12:07:30 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973ee4c-fe8c-4e0d-bd2a-2a1d1449156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:30 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Volume volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 (18a85c60-c4b5-4ae6-8a26-7917b29b9d16): created successfully Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973ee4c-fe8c-4e0d-bd2a-2a1d1449156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Flow 'volume_create_manager' (76403c28-02a1-4c9b-8a41-c9efb465ab7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3b2d3821-baa1-460c-b935-7e388c633188 tempest-VolumesCloneNegativeTest-196766336 None] Created volume successfully. Aug 26 12:07:30 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Deleted volume successfully. Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-59fe77ac-296f-4d4a-a2e8-2587b5d81ecd tempest-VolumesImageMetadata-473400010 None] Lock "cinder-cfd3f301-382c-4c87-af91-200e8931d19e-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:31 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717 1073741824" returned: 0 in 0.539s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:31 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717 Aug 26 12:07:31 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:31 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717" returned: 0 in 0.278s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.436s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589e7f37-3808-4fc0-9166-3d92dd5e4722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b48461f-52e7-49b6-83f1-3190fb178717', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e74dc91-7ed1-47e1-8ae2-abbfcab550b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Creating offline snapshot 7ebb6028-a5c8-40b5-a79e-cfbb23d02abe of volume a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:07:31 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Volume volume-0b48461f-52e7-49b6-83f1-3190fb178717 (0b48461f-52e7-49b6-83f1-3190fb178717): created successfully Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e74dc91-7ed1-47e1-8ae2-abbfcab550b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (72accf56-583c-4911-82ae-e3402e27df61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8adfcbb-8c51-485f-8d85-45aec73bb9a6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:31 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0e97dee1-1503-43b5-ae2c-72a16b72948c tempest-VolumesActionsTest-2133184747 None] Created volume successfully. Aug 26 12:07:31 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d Aug 26 12:07:31 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Acquiring lock "cinder-18a85c60-c4b5-4ae6-8a26-7917b29b9d16-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Lock "cinder-18a85c60-c4b5-4ae6-8a26-7917b29b9d16-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Acquiring lock "cinder-quobyte-18a85c60-c4b5-4ae6-8a26-7917b29b9d16" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Lock "cinder-quobyte-18a85c60-c4b5-4ae6-8a26-7917b29b9d16" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab4f0c6-814a-4bf3-9634-b51198f09957]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:31 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 Aug 26 12:07:31 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:31 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d" returned: 0 in 0.528s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:32 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe 1G Aug 26 12:07:32 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:32 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16" returned: 0 in 0.413s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:32 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16 Aug 26 12:07:32 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:32 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe 1G" returned: 0 in 0.509s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a257a823-b441-4ece-a8af-973469e2491d -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:32 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-18a85c60-c4b5-4ae6-8a26-7917b29b9d16" returned: 0 in 0.277s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:32 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a257a823-b441-4ece-a8af-973469e2491d -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe Aug 26 12:07:32 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Lock "cinder-quobyte-18a85c60-c4b5-4ae6-8a26-7917b29b9d16" released by "delete_volume" :: held 0.754s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Created reservations ['d3e75e30-4718-43d5-91b0-b2f22fbe781e', 'c8d3393e-b51c-4f5e-9684-af0eeeb57cb4', '68b711a5-1edd-44f0-90c2-02fb21abb047', '8a35fc72-a59b-4c87-848d-a15358fbc0e3'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Acquiring lock "cinder-0b48461f-52e7-49b6-83f1-3190fb178717-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:32 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Lock "cinder-0b48461f-52e7-49b6-83f1-3190fb178717-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:32 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Acquiring lock "cinder-quobyte-0b48461f-52e7-49b6-83f1-3190fb178717" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Lock "cinder-quobyte-0b48461f-52e7-49b6-83f1-3190fb178717" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c079d02b-2b78-472f-ae83-0a7ca6017fab]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:32 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a257a823-b441-4ece-a8af-973469e2491d -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" returned: 0 in 0.489s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:32 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe is being set with open permissions: ugo+rw Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:33 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe Aug 26 12:07:33 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:33 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717 Aug 26 12:07:33 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:33 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.390s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:33 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Deleted volume successfully. Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-28dda6f2-005a-4f21-99e5-7997d84c1341 tempest-VolumesCloneNegativeTest-196766336 None] Lock "cinder-18a85c60-c4b5-4ae6-8a26-7917b29b9d16-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:33 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" returned: 0 in 0.362s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:33 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.info Aug 26 12:07:33 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:33 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717" returned: 0 in 0.508s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:33 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717 Aug 26 12:07:33 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:33 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:33 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0b48461f-52e7-49b6-83f1-3190fb178717" returned: 0 in 0.281s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.info" returned: 0 in 0.340s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:33 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.info is being set with open permissions: ugo+rw Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Lock "cinder-quobyte-0b48461f-52e7-49b6-83f1-3190fb178717" released by "delete_volume" :: held 0.861s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:33 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.info Aug 26 12:07:33 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Created reservations ['504cb071-6804-49d8-a575-c40b322057d0', '39c2b497-a290-42d5-a9bf-2631fe23c1e5', 'c7ad048d-0785-411a-9a7a-6671830abda8', '0c19271b-b835-460a-9348-a3f416575a10'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:34 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Flow 'volume_create_manager' (4701a609-a2a2-4621-b805-a1a73e252e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:34 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175472be-50c0-4fea-9826-8f2ff6401208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175472be-50c0-4fea-9826-8f2ff6401208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1288781021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66327d2b-9c83-45c0-ac61-ef52998ea774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52e0be275ca41f7bd685c550b949d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:34Z,use_quota=True,user_id='7f5de42be82a46a785a91e0177205bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccd950f-5b36-42e0-8008-3b17ff40942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccd950f-5b36-42e0-8008-3b17ff40942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ddaacf-5b06-4c52-b578-de9873e88991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ddaacf-5b06-4c52-b578-de9873e88991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66327d2b-9c83-45c0-ac61-ef52998ea774', 'volume_name': 'volume-66327d2b-9c83-45c0-ac61-ef52998ea774', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17f042f-d9a1-4592-897b-c8f260d03b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17f042f-d9a1-4592-897b-c8f260d03b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b91189a-4d87-40dd-8d67-27493cefe66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Volume 66327d2b-9c83-45c0-ac61-ef52998ea774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66327d2b-9c83-45c0-ac61-ef52998ea774', 'volume_size': 1} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:34 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.info" returned: 0 in 0.456s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.826s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.096s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1288781021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66327d2b-9c83-45c0-ac61-ef52998ea774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52e0be275ca41f7bd685c550b949d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:34Z,use_quota=True,user_id='7f5de42be82a46a785a91e0177205bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Creating volume 66327d2b-9c83-45c0-ac61-ef52998ea774 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:34 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:34 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 1073741824 Aug 26 12:07:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a49f6281-d62d-4516-b3ba-77a532f2f5e1 tempest-VolumesDeleteCascade-1365158057 None] Create snapshot completed successfully Aug 26 12:07:34 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:34 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.412s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Deleted volume successfully. Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c477913-2873-4ec7-b964-80614578992e tempest-VolumesActionsTest-1982233667 None] Lock "cinder-0b48461f-52e7-49b6-83f1-3190fb178717-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (c0636c42-8f3f-4c90-9a79-3d9dcea4e27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cd2eeb-a8c1-4fa2-b908-23021c455b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cd2eeb-a8c1-4fa2-b908-23021c455b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1720393224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcec67dc-a67e-4cf0-b04b-e08a134686f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:35Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3306ec82-5747-4bd1-8b5e-3af3df469c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3306ec82-5747-4bd1-8b5e-3af3df469c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:34 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00714b6a-79e4-49b7-8645-9b327ac1e2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00714b6a-79e4-49b7-8645-9b327ac1e2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcec67dc-a67e-4cf0-b04b-e08a134686f6', 'volume_name': 'volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46ac314-6451-4a71-ae68-5a9e618d3ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46ac314-6451-4a71-ae68-5a9e618d3ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80696637-befe-43c8-9511-f659f9e158ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:34 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Volume bcec67dc-a67e-4cf0-b04b-e08a134686f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6', 'volume_size': 1} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 1073741824" returned: 0 in 0.606s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:34 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 Aug 26 12:07:34 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:35 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774" returned: 0 in 0.301s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1720393224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcec67dc-a67e-4cf0-b04b-e08a134686f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a29b0a385d4e9d8c8b63301f1a4289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:35Z,use_quota=True,user_id='787979c2c52e4d35ac0e3f745ef1085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Creating volume bcec67dc-a67e-4cf0-b04b-e08a134686f6 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:35 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:35 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 1073741824 Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b91189a-4d87-40dd-8d67-27493cefe66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66327d2b-9c83-45c0-ac61-ef52998ea774', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:35 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd678e8-a877-4798-9c66-a23c9bb1d511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:35 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Volume volume-66327d2b-9c83-45c0-ac61-ef52998ea774 (66327d2b-9c83-45c0-ac61-ef52998ea774): created successfully Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd678e8-a877-4798-9c66-a23c9bb1d511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Flow 'volume_create_manager' (4701a609-a2a2-4621-b805-a1a73e252e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:35 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-58f00ff4-f4db-4dec-9f85-7576643c46e6 tempest-SnapshotMetadataTestJSON-359708187 None] Created volume successfully. Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:35 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 1073741824" returned: 0 in 0.493s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:35 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 Aug 26 12:07:35 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:35 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6" returned: 0 in 0.250s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.522s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80696637-befe-43c8-9511-f659f9e158ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f48ef6b-f53b-4dd5-9ef0-769a6684af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Creating offline snapshot 6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 of volume a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:07:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Volume volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 (bcec67dc-a67e-4cf0-b04b-e08a134686f6): created successfully Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f48ef6b-f53b-4dd5-9ef0-769a6684af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Flow 'volume_create_manager' (c0636c42-8f3f-4c90-9a79-3d9dcea4e27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abdff74-9d2b-42a8-a630-7627befac034]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-01795494-6d3f-479e-96f0-fcff4643fe0b tempest-VolumesActionsTest-2133184747 None] Created volume successfully. Aug 26 12:07:36 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe Aug 26 12:07:36 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:36 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" returned: 0 in 0.417s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a257a823-b441-4ece-a8af-973469e2491d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:36 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 1G Aug 26 12:07:36 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (4d396354-11ac-44d2-93a8-ef2796952ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5ff124-eab3-47d9-af6d-b1a5460d8e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5ff124-eab3-47d9-af6d-b1a5460d8e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1228647350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c78b6bc-1711-4555-a4c7-ab43ee0062eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:37Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487c20e1-3ecd-4d64-b9ae-7f9ddfcc5118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487c20e1-3ecd-4d64-b9ae-7f9ddfcc5118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ba361b-a5c8-4134-bf6d-4f90a4cee288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ba361b-a5c8-4134-bf6d-4f90a4cee288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c78b6bc-1711-4555-a4c7-ab43ee0062eb', 'volume_name': 'volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a70bffc-8e73-4c43-b561-19af9ce11fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a70bffc-8e73-4c43-b561-19af9ce11fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0156c0-a5a5-4534-a7d8-ee79bfa79a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Volume 6c78b6bc-1711-4555-a4c7-ab43ee0062eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb', 'volume_size': 1} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:36 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 1G" returned: 0 in 0.487s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:36 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 Aug 26 12:07:37 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:37 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0" returned: 0 in 0.310s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:37 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 is being set with open permissions: ugo+rw Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:37 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 Aug 26 12:07:37 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "cinder-bcec67dc-a67e-4cf0-b04b-e08a134686f6-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Lock "cinder-bcec67dc-a67e-4cf0-b04b-e08a134686f6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "cinder-quobyte-bcec67dc-a67e-4cf0-b04b-e08a134686f6" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:37 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Lock "cinder-quobyte-bcec67dc-a67e-4cf0-b04b-e08a134686f6" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0" returned: 0 in 0.270s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.619s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0278b5a-8b0e-4e79-a08a-c13c5a950897]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.233s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Creating offline snapshot ef973840-2d44-4d07-809c-681113360729 of volume 66327d2b-9c83-45c0-ac61-ef52998ea774 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:07:37 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2bc1bfef-f4a7-4314-98b0-c81ead967ea4 tempest-VolumesDeleteCascade-1365158057 None] Create snapshot completed successfully Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9de121f-cd3b-4e67-9bb4-d76678670ae9]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:37 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 Aug 26 12:07:37 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:37 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 Aug 26 12:07:37 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:37 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6" returned: 0 in 0.397s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:38 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774" returned: 0 in 0.362s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:38 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6 Aug 26 12:07:38 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:38 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 1G Aug 26 12:07:38 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:38 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcec67dc-a67e-4cf0-b04b-e08a134686f6" returned: 0 in 0.250s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Lock "cinder-quobyte-bcec67dc-a67e-4cf0-b04b-e08a134686f6" released by "delete_volume" :: held 0.711s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Created reservations ['3432b720-509f-4c93-a4b5-27dfb152d3d0', '42ccd88d-c4d2-46d6-aaf9-f891b06508ab', 'cfc28d96-792b-4b5c-bd94-325e9e494ec8', '15b27808-d402-4c6d-beb8-f54319cacdc6'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:38 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:38 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:38 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 1G" returned: 0 in 0.438s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66327d2b-9c83-45c0-ac61-ef52998ea774 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:38 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66327d2b-9c83-45c0-ac61-ef52998ea774 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 Aug 26 12:07:38 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:38 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.285s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:38 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Deleted volume successfully. Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-a257a823-b441-4ece-a8af-973469e2491d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8ba774de-e913-43f9-8f99-d391697939c8 tempest-VolumesActionsTest-2133184747 None] Lock "cinder-bcec67dc-a67e-4cf0-b04b-e08a134686f6-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-a257a823-b441-4ece-a8af-973469e2491d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Performing cascade delete. {{(pid=94387) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-6e2a79bd-c5dc-47a1-81de-b6d485fbddd0-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-6e2a79bd-c5dc-47a1-81de-b6d485fbddd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-a257a823-b441-4ece-a8af-973469e2491d" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-a257a823-b441-4ece-a8af-973469e2491d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-6e2a79bd-c5dc-47a1-81de-b6d485fbddd0" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-6e2a79bd-c5dc-47a1-81de-b6d485fbddd0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Deleting offline snapshot 6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 of volume a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:07:38 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] snapshot_file for this snap is: volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66327d2b-9c83-45c0-ac61-ef52998ea774 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729" returned: 0 in 0.437s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:38 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 is being set with open permissions: ugo+rw Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45f7846-751a-40d3-802a-e7f4cbfceabf]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:38 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 Aug 26 12:07:38 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:39 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 Aug 26 12:07:39 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:39 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:39 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.info Aug 26 12:07:39 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:39 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0" returned: 0 in 0.400s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a257a823-b441-4ece-a8af-973469e2491d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[183f4db7-c942-413d-9d11-cf286d145758]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:39 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe Aug 26 12:07:39 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:39 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.info" returned: 0 in 0.314s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:39 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.info is being set with open permissions: ugo+rw Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:39 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.info Aug 26 12:07:39 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:39 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.info" returned: 0 in 0.255s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:39 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1228647350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c78b6bc-1711-4555-a4c7-ab43ee0062eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:37Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Creating volume 6c78b6bc-1711-4555-a4c7-ab43ee0062eb {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:39 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" returned: 0 in 0.483s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a257a823-b441-4ece-a8af-973469e2491d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:07:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:39 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb 1073741824 Aug 26 12:07:39 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:39 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 Aug 26 12:07:39 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-19e80fe6-2308-4f31-9255-2d480e229552 tempest-SnapshotMetadataTestJSON-359708187 None] Create snapshot completed successfully Aug 26 12:07:40 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0" returned: 0 in 0.470s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:40 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb 1073741824" returned: 0 in 0.503s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:40 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0 Aug 26 12:07:40 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:40 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb Aug 26 12:07:40 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:40 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.6e2a79bd-c5dc-47a1-81de-b6d485fbddd0" returned: 0 in 0.311s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:40 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb" returned: 0 in 0.299s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-6e2a79bd-c5dc-47a1-81de-b6d485fbddd0" released by "_delete_snapshot" :: held 1.789s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-a257a823-b441-4ece-a8af-973469e2491d" released by "delete_snapshot" :: held 1.819s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0156c0-a5a5-4534-a7d8-ee79bfa79a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41372747-50e3-46af-a521-259118b30eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:40 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Volume volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb (6c78b6bc-1711-4555-a4c7-ab43ee0062eb): created successfully Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41372747-50e3-46af-a521-259118b30eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (4d396354-11ac-44d2-93a8-ef2796952ff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4e5a2eb5-60a3-4f63-8145-a2665c5bf359 tempest-VolumesGetTest-2096632885 None] Created volume successfully. Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Created reservations ['b0fd46e0-d765-4b85-84a0-f04d02d850b4', 'ac1f390c-ed06-4f00-adb4-f2a711a1b8ec', '08dcf40e-3049-432a-8c7b-d24a12ed0eda', 'a4e435db-f77b-4f98-9c10-11e5bfea8036'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Delete snapshot completed successfully. Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-6e2a79bd-c5dc-47a1-81de-b6d485fbddd0-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-7ebb6028-a5c8-40b5-a79e-cfbb23d02abe-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-7ebb6028-a5c8-40b5-a79e-cfbb23d02abe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-a257a823-b441-4ece-a8af-973469e2491d" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-a257a823-b441-4ece-a8af-973469e2491d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Deleting offline snapshot 7ebb6028-a5c8-40b5-a79e-cfbb23d02abe of volume a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:07:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] snapshot_file for this snap is: volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca9312-09be-4fd5-a5a3-48f9cfb4c2d5]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:41 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe Aug 26 12:07:41 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Acquiring lock "cinder-ef973840-2d44-4d07-809c-681113360729-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-ef973840-2d44-4d07-809c-681113360729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Acquiring lock "cinder-quobyte-66327d2b-9c83-45c0-ac61-ef52998ea774" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-quobyte-66327d2b-9c83-45c0-ac61-ef52998ea774" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Acquiring lock "cinder-quobyte-ef973840-2d44-4d07-809c-681113360729" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-quobyte-ef973840-2d44-4d07-809c-681113360729" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Deleting offline snapshot ef973840-2d44-4d07-809c-681113360729 of volume 66327d2b-9c83-45c0-ac61-ef52998ea774 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:07:41 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] snapshot_file for this snap is: volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" returned: 0 in 0.606s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a257a823-b441-4ece-a8af-973469e2491d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b820f6-c0ff-4a4c-aad7-4f053183584d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c94323f-d89b-486b-b21f-17f0cc5a937b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:41 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 Aug 26 12:07:41 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:41 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d Aug 26 12:07:41 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (46f4e19a-c0e2-4ddc-9010-7e70f1f700c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64397c84-1007-452d-9e6d-b5d8d9ee697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64397c84-1007-452d-9e6d-b5d8d9ee697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1784362276',display_name='tempest-VolumesGetTest-Volume-546480819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4743f-3333-4de8-a5f7-9cfab3413953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:42Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a0356-54f9-48db-a9c4-1cb2a0456df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a0356-54f9-48db-a9c4-1cb2a0456df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e4741b-47f6-4e53-8e6c-ebf63861714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e4741b-47f6-4e53-8e6c-ebf63861714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af4743f-3333-4de8-a5f7-9cfab3413953', 'volume_name': 'volume-6af4743f-3333-4de8-a5f7-9cfab3413953', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6a5b9a-4fa0-4302-b27a-2b51d5e69de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6a5b9a-4fa0-4302-b27a-2b51d5e69de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac4f6f9-bdb6-4ce3-8608-9302f7c9109a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:42 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Volume 6af4743f-3333-4de8-a5f7-9cfab3413953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af4743f-3333-4de8-a5f7-9cfab3413953', 'volume_size': 1} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1784362276',display_name='tempest-VolumesGetTest-Volume-546480819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4743f-3333-4de8-a5f7-9cfab3413953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:42Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Creating volume 6af4743f-3333-4de8-a5f7-9cfab3413953 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:42 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:42 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729" returned: 0 in 0.438s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66327d2b-9c83-45c0-ac61-ef52998ea774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:07:42 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:42 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953 1073741824 Aug 26 12:07:42 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d" returned: 0 in 0.445s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8e084f-b0c2-4bae-af1d-7076016c62cb]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:42 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe Aug 26 12:07:42 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:42 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 Aug 26 12:07:42 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:42 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" returned: 0 in 0.377s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:42 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe Aug 26 12:07:42 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:42 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:42 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953 1073741824" returned: 0 in 0.465s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774" returned: 0 in 0.419s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:42 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 Aug 26 12:07:42 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:42 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953 Aug 26 12:07:42 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:42 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d.7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" returned: 0 in 0.290s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-7ebb6028-a5c8-40b5-a79e-cfbb23d02abe" released by "_delete_snapshot" :: held 1.865s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-a257a823-b441-4ece-a8af-973469e2491d" released by "delete_snapshot" :: held 1.901s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:42 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953" returned: 0 in 0.301s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac4f6f9-bdb6-4ce3-8608-9302f7c9109a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af4743f-3333-4de8-a5f7-9cfab3413953', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fba6e4f-cd73-4a07-b3da-a2177d43ef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Created reservations ['374a1c1b-553c-42f9-91c1-3649dcae5ec4', '0ba45ac9-959c-4c41-b4a6-c37664a5195a', 'e01244e2-3b11-4338-9f7c-cb35ff72ddb7', 'ef213318-1bd8-4631-a4dc-0097ff35d9e0'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:42 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Volume volume-6af4743f-3333-4de8-a5f7-9cfab3413953 (6af4743f-3333-4de8-a5f7-9cfab3413953): created successfully Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fba6e4f-cd73-4a07-b3da-a2177d43ef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:42 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (46f4e19a-c0e2-4ddc-9010-7e70f1f700c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729" returned: 0 in 0.411s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:42 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ff81c4c4-e940-4228-9512-8cb6e88f6052 tempest-VolumesGetTest-2096632885 None] Created volume successfully. Aug 26 12:07:42 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729 Aug 26 12:07:42 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Delete snapshot completed successfully. Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-7ebb6028-a5c8-40b5-a79e-cfbb23d02abe-delete_snapshot" released by "delete_snapshot" :: held 2.169s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Snapshots deleted, issuing volume delete {{(pid=94387) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-a257a823-b441-4ece-a8af-973469e2491d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-a257a823-b441-4ece-a8af-973469e2491d" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[627352fe-1018-44c3-b5ab-17565d746506]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:43 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774.ef973840-2d44-4d07-809c-681113360729" returned: 0 in 0.288s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:43 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d Aug 26 12:07:43 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-quobyte-ef973840-2d44-4d07-809c-681113360729" released by "_delete_snapshot" :: held 1.742s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-quobyte-66327d2b-9c83-45c0-ac61-ef52998ea774" released by "delete_snapshot" :: held 1.775s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Created reservations ['60f9455e-69e6-4d53-846e-524b5d648080', '68e167ff-79eb-48b0-91a1-5b9df8646e6f', 'a9735f57-9be8-419a-b931-12cac4f23600', 'ac02dfd9-35e3-4bd9-8e75-9a4d9c632b8f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Delete snapshot completed successfully. Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-316d724b-467f-4cfe-b572-2e62f10f5e2f tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-ef973840-2d44-4d07-809c-681113360729-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:43 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d" returned: 0 in 0.466s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:43 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d Aug 26 12:07:43 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Acquiring lock "cinder-66327d2b-9c83-45c0-ac61-ef52998ea774-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-66327d2b-9c83-45c0-ac61-ef52998ea774-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Acquiring lock "cinder-quobyte-66327d2b-9c83-45c0-ac61-ef52998ea774" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:43 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a257a823-b441-4ece-a8af-973469e2491d" returned: 0 in 0.283s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-quobyte-66327d2b-9c83-45c0-ac61-ef52998ea774" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-a257a823-b441-4ece-a8af-973469e2491d" released by "delete_volume" :: held 0.864s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[381c20ec-fb96-4848-94ee-a9b631884487]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Created reservations ['80750598-4b6e-49eb-8169-3887d35eec0b', '926bb912-5ea9-4bf8-ab10-d367e9059e07', '44ae4b0c-4239-4472-9bb0-9335e5df9f13', '3221a856-1b6f-424f-91f9-f6e71dc897f0'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:44 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 Aug 26 12:07:44 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:44 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:44 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-6af4743f-3333-4de8-a5f7-9cfab3413953-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Lock "cinder-6af4743f-3333-4de8-a5f7-9cfab3413953-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-quobyte-6af4743f-3333-4de8-a5f7-9cfab3413953" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:44 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-6af4743f-3333-4de8-a5f7-9cfab3413953" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.404s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:44 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Deleted volume successfully. Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f79b98-bf75-4fd4-a6f7-54a6d55d45eb]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774" returned: 0 in 0.659s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e08a72bd-7b7a-4710-b84a-e0da1d3ae56c tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-a257a823-b441-4ece-a8af-973469e2491d-delete_volume" released by "delete_volume" :: held 5.904s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:44 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774 Aug 26 12:07:44 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:44 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953 Aug 26 12:07:44 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:44 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-66327d2b-9c83-45c0-ac61-ef52998ea774" returned: 0 in 0.304s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-quobyte-66327d2b-9c83-45c0-ac61-ef52998ea774" released by "delete_volume" :: held 1.050s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Created reservations ['b84cbe41-351f-4727-96ee-a57e6e1c5529', 'c75dd939-9585-4537-bd4b-34b7989cb130', 'c071c880-5fea-4a58-98f3-c3db79781d83', '1ac859a6-ddec-4832-95d3-8c5d79077daa'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Flow 'volume_create_manager' (f0b656fc-341c-4f63-a30a-407d45f417b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:45 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70be0c3-474c-4f48-98cb-5a70273f9488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953" returned: 0 in 0.604s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:45 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:45 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70be0c3-474c-4f48-98cb-5a70273f9488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1951151031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfeb1803-8bb1-4769-94c4-1a02a18c5804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b7023ea24d45a98a803126a094afda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:45Z,use_quota=True,user_id='029e28196d564e1e9b198840b2b317aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3d95b5-5fd9-405a-b171-4a4b1b622f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:45 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953 Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3d95b5-5fd9-405a-b171-4a4b1b622f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:45 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2918e44-7b18-46f5-a11d-8d713baa8a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2918e44-7b18-46f5-a11d-8d713baa8a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfeb1803-8bb1-4769-94c4-1a02a18c5804', 'volume_name': 'volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca54df2-9419-4f88-9cd6-7e4487413bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca54df2-9419-4f88-9cd6-7e4487413bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffb4599-94b2-44f9-a119-c1f5a138a8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:45 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Volume cfeb1803-8bb1-4769-94c4-1a02a18c5804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804', 'volume_size': 1} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1951151031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfeb1803-8bb1-4769-94c4-1a02a18c5804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b7023ea24d45a98a803126a094afda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:45Z,use_quota=True,user_id='029e28196d564e1e9b198840b2b317aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Creating volume cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:45 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:45 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 1073741824 Aug 26 12:07:45 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:45 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.307s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:45 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Deleted volume successfully. Aug 26 12:07:45 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6af4743f-3333-4de8-a5f7-9cfab3413953" returned: 0 in 0.326s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-6af4743f-3333-4de8-a5f7-9cfab3413953" released by "delete_volume" :: held 1.020s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6a009c1d-e543-43e4-a104-5aa72a8a66dd tempest-SnapshotMetadataTestJSON-359708187 None] Lock "cinder-66327d2b-9c83-45c0-ac61-ef52998ea774-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Created reservations ['c431073a-0ef4-4948-8332-42ef42a4b9d4', '440dcdf5-aa24-4a10-b812-9d00f570a4d9', 'e4152b7f-5836-40f3-bae6-60c0fea9413d', '0955b817-1a46-467a-8e80-1708c659531d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:45 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:45 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:45 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 1073741824" returned: 0 in 0.547s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:45 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 Aug 26 12:07:45 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:45 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.267s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:45 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:45 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Deleted volume successfully. Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7c40f16d-2a5e-4367-9443-575bc3c7e63f tempest-VolumesGetTest-2096632885 None] Lock "cinder-6af4743f-3333-4de8-a5f7-9cfab3413953-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:46 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804" returned: 0 in 0.308s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffb4599-94b2-44f9-a119-c1f5a138a8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fe8e36-212c-4327-a1eb-d26417b87ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:46 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Volume volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 (cfeb1803-8bb1-4769-94c4-1a02a18c5804): created successfully Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fe8e36-212c-4327-a1eb-d26417b87ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Flow 'volume_create_manager' (f0b656fc-341c-4f63-a30a-407d45f417b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-77348a27-8736-498d-886d-cdd5e734ed80 tempest-VolumesDeleteCascade-1365158057 None] Created volume successfully. Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-6c78b6bc-1711-4555-a4c7-ab43ee0062eb-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Lock "cinder-6c78b6bc-1711-4555-a4c7-ab43ee0062eb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-quobyte-6c78b6bc-1711-4555-a4c7-ab43ee0062eb" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-6c78b6bc-1711-4555-a4c7-ab43ee0062eb" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e473d36-ae4b-48f3-8e97-d1090eff7c0f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:47 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb Aug 26 12:07:47 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:47 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb" returned: 0 in 0.464s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:47 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb Aug 26 12:07:47 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Creating offline snapshot 38f0829a-539d-4e90-8f0b-f3fade99657c of volume cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ed73d4-0f9d-427d-82c0-ea56cfbf33ae]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:47 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 Aug 26 12:07:47 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:47 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6c78b6bc-1711-4555-a4c7-ab43ee0062eb" returned: 0 in 0.413s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-6c78b6bc-1711-4555-a4c7-ab43ee0062eb" released by "delete_volume" :: held 0.938s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Created reservations ['265ab5b7-38d4-4cef-adf7-3ed5091d4043', '19a2e4c9-0807-4e7e-8261-d509c4dacd0a', 'e68cbc5d-38ec-4014-835e-eacb96c9a9f9', '8346b8b1-5f73-451a-b4cf-c5c4826cca4c'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:47 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804" returned: 0 in 0.452s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:48 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:07:48 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:48 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c 1G Aug 26 12:07:48 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:48 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.271s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:48 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:07:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Deleted volume successfully. Aug 26 12:07:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-34aef225-474a-4ba3-8d35-c602f2290923 tempest-VolumesGetTest-2096632885 None] Lock "cinder-6c78b6bc-1711-4555-a4c7-ab43ee0062eb-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:48 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c 1G" returned: 0 in 0.476s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:48 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c Aug 26 12:07:48 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:48 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c" returned: 0 in 0.404s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:48 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c is being set with open permissions: ugo+rw Aug 26 12:07:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:48 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c Aug 26 12:07:48 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:49 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c" returned: 0 in 0.340s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:49 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.info Aug 26 12:07:49 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:49 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.info" returned: 0 in 0.384s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:49 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.info is being set with open permissions: ugo+rw Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:49 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.info Aug 26 12:07:49 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (69d91568-eb7c-41a1-a05a-ecb6e2beeab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2282993c-e5ac-4304-80ac-b5418fa2b622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2282993c-e5ac-4304-80ac-b5418fa2b622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1820746535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5e170d-00e1-4631-9d79-05c17509516b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:50Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561fd764-b03f-4044-a6f1-6397c4ef7775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561fd764-b03f-4044-a6f1-6397c4ef7775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f0954c-828e-4e1f-8ea4-27f726c29810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f0954c-828e-4e1f-8ea4-27f726c29810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb5e170d-00e1-4631-9d79-05c17509516b', 'volume_name': 'volume-cb5e170d-00e1-4631-9d79-05c17509516b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e943419-d5e4-4c2f-b546-106cb046b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e943419-d5e4-4c2f-b546-106cb046b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c42df-8290-4fb9-94c6-9d54724feef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:49 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Volume cb5e170d-00e1-4631-9d79-05c17509516b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb5e170d-00e1-4631-9d79-05c17509516b', 'volume_size': 1} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:49 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.info" returned: 0 in 0.321s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1820746535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5e170d-00e1-4631-9d79-05c17509516b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:50Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Creating volume cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:50 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:50 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b 1073741824 Aug 26 12:07:50 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6612fc71-0714-4582-be0b-39f8eddcb524 tempest-VolumesDeleteCascade-1365158057 None] Create snapshot completed successfully Aug 26 12:07:50 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b 1073741824" returned: 0 in 0.535s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:50 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b Aug 26 12:07:50 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:50 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b" returned: 0 in 0.374s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c42df-8290-4fb9-94c6-9d54724feef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5e170d-00e1-4631-9d79-05c17509516b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a326ec-58aa-4133-852e-e9cd317c9d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:51 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Volume volume-cb5e170d-00e1-4631-9d79-05c17509516b (cb5e170d-00e1-4631-9d79-05c17509516b): created successfully Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a326ec-58aa-4133-852e-e9cd317c9d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (69d91568-eb7c-41a1-a05a-ecb6e2beeab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7b841214-9d61-4755-926d-45fa21598423 tempest-VolumesGetTest-2096632885 None] Created volume successfully. Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Flow 'volume_create_manager' (44ba7259-9881-4ea3-9c49-1f2c5d74cd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216d20d4-4ef8-436e-a3d5-314da288d862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216d20d4-4ef8-436e-a3d5-314da288d862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2092771110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30686009-286a-4b05-9863-9db5618e702b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b7023ea24d45a98a803126a094afda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38f0829a-539d-4e90-8f0b-f3fade99657c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:51Z,use_quota=True,user_id='029e28196d564e1e9b198840b2b317aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fbb8e8-7057-4169-85bb-ef09c31861d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fbb8e8-7057-4169-85bb-ef09c31861d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675309f7-a5d6-4544-abe6-f85e40ab3753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675309f7-a5d6-4544-abe6-f85e40ab3753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '30686009-286a-4b05-9863-9db5618e702b', 'volume_name': 'volume-30686009-286a-4b05-9863-9db5618e702b', 'volume_size': 1, 'snapshot_id': '38f0829a-539d-4e90-8f0b-f3fade99657c'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac38042e-60b9-4504-8438-3affcad7b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac38042e-60b9-4504-8438-3affcad7b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b579334c-0a78-419a-97df-baf81acdf6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:51 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Volume 30686009-286a-4b05-9863-9db5618e702b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-30686009-286a-4b05-9863-9db5618e702b', 'volume_size': 1, 'snapshot_id': '38f0829a-539d-4e90-8f0b-f3fade99657c'} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-38f0829a-539d-4e90-8f0b-f3fade99657c-30686009-286a-4b05-9863-9db5618e702b" by "_create_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-38f0829a-539d-4e90-8f0b-f3fade99657c-30686009-286a-4b05-9863-9db5618e702b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Creating volume 30686009-286a-4b05-9863-9db5618e702b from snapshot 38f0829a-539d-4e90-8f0b-f3fade99657c {{(pid=94387) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-30686009-286a-4b05-9863-9db5618e702b" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-30686009-286a-4b05-9863-9db5618e702b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] snapshot: 38f0829a-539d-4e90-8f0b-f3fade99657c, volume: 30686009-286a-4b05-9863-9db5618e702b, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de5e466-eea4-4232-8bb3-f31da64d98f8]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:51 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c Aug 26 12:07:51 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:52 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c" returned: 0 in 0.496s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Flow 'volume_create_manager' (588c0c83-eca0-48a8-9a39-e901cebac9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f031fbd-ae08-4342-bfdc-f5a5184edb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[777727bb-f23f-4ace-a376-05842cbfe2be]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f031fbd-ae08-4342-bfdc-f5a5184edb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1901535608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0384757-e127-444d-a5c3-9f6e4fef410f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845da4992e884104b3d4370d54f577e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:52Z,use_quota=True,user_id='e016bdd5555c44e4968a12e8e821f635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12f6f6d-ae77-4305-aa39-54a5cebd4b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12f6f6d-ae77-4305-aa39-54a5cebd4b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3334c0fb-4fe9-4e49-bd35-c74c28cdda00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3334c0fb-4fe9-4e49-bd35-c74c28cdda00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0384757-e127-444d-a5c3-9f6e4fef410f', 'volume_name': 'volume-e0384757-e127-444d-a5c3-9f6e4fef410f', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3d8f84-1ae5-4673-9826-07271fcb24fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3d8f84-1ae5-4673-9826-07271fcb24fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02759974-4dd3-4d5a-808d-a7fbb50718c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Volume e0384757-e127-444d-a5c3-9f6e4fef410f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0384757-e127-444d-a5c3-9f6e4fef410f', 'volume_size': 1} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:52 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 Aug 26 12:07:52 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (62dd0b47-43e1-49e0-b1b8-92bfd5a4d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b1bed3-2633-4123-8c40-ba3855115f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b1bed3-2633-4123-8c40-ba3855115f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-269309689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3833a77d-f46d-4db2-91a4-ef66df71b5b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cb5e170d-00e1-4631-9d79-05c17509516b,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:53Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24e7ebb-4fe0-4592-8837-b624c923b4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24e7ebb-4fe0-4592-8837-b624c923b4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d70a51-a976-41fa-a609-c6ab1036b4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804" returned: 0 in 0.436s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d70a51-a976-41fa-a609-c6ab1036b4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3833a77d-f46d-4db2-91a4-ef66df71b5b2', 'volume_name': 'volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2', 'volume_size': 1, 'source_volid': 'cb5e170d-00e1-4631-9d79-05c17509516b', 'source_volstatus': 'available'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977d597a-2ebf-4b1c-b0a2-b27511f096de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977d597a-2ebf-4b1c-b0a2-b27511f096de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971ed91a-4410-4e85-8666-6b6019760141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:52 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Volume 3833a77d-f46d-4db2-91a4-ef66df71b5b2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2', 'volume_size': 1, 'source_volid': 'cb5e170d-00e1-4631-9d79-05c17509516b', 'source_volstatus': 'available'} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:52 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b Aug 26 12:07:52 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:58 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b" returned: 0 in 5.319s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:07:58 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Converted 1024.00 MB image at 192.48 MB/s Aug 26 12:07:58 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b is being set with open permissions: ugo+rw Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:58 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b Aug 26 12:07:58 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:58 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-30686009-286a-4b05-9863-9db5618e702b" released by "_copy_volume_from_snapshot" :: held 6.668s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-38f0829a-539d-4e90-8f0b-f3fade99657c-30686009-286a-4b05-9863-9db5618e702b" released by "_create_volume_from_snapshot" :: held 6.756s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.780s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.064s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1901535608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0384757-e127-444d-a5c3-9f6e4fef410f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845da4992e884104b3d4370d54f577e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:07:52Z,use_quota=True,user_id='e016bdd5555c44e4968a12e8e821f635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Creating volume e0384757-e127-444d-a5c3-9f6e4fef410f {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:07:58 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:58 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f 1073741824 Aug 26 12:07:58 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b579334c-0a78-419a-97df-baf81acdf6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30686009-286a-4b05-9863-9db5618e702b', 'volume_size': 1, 'snapshot_id': '38f0829a-539d-4e90-8f0b-f3fade99657c'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2673c92-1693-4f35-8077-10cb8cee11be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Volume volume-30686009-286a-4b05-9863-9db5618e702b (30686009-286a-4b05-9863-9db5618e702b): created successfully Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2673c92-1693-4f35-8077-10cb8cee11be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Flow 'volume_create_manager' (44ba7259-9881-4ea3-9c49-1f2c5d74cd27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-00d0b3cc-192f-4fe2-9d5c-4592be77a50b tempest-VolumesDeleteCascade-1365158057 None] Created volume successfully. Aug 26 12:07:58 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f 1073741824" returned: 0 in 0.441s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:58 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f Aug 26 12:07:58 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:59 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f" returned: 0 in 0.258s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.387s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:07:59 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Cloning volume cb5e170d-00e1-4631-9d79-05c17509516b to volume 3833a77d-f46d-4db2-91a4-ef66df71b5b2 Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02759974-4dd3-4d5a-808d-a7fbb50718c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0384757-e127-444d-a5c3-9f6e4fef410f', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b9b3d1-ead3-4814-9481-88457ba18da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:07:59 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Volume volume-e0384757-e127-444d-a5c3-9f6e4fef410f (e0384757-e127-444d-a5c3-9f6e4fef410f): created successfully Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b9b3d1-ead3-4814-9481-88457ba18da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Flow 'volume_create_manager' (588c0c83-eca0-48a8-9a39-e901cebac9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Creating offline snapshot 48386df9-e36f-4e2c-a820-c362b3bc8908 of volume cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:07:59 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1421bc1b-2f36-49c7-93dc-fd914af04c41 tempest-VolumesTransfersV355Test-2003409352 None] Created volume successfully. Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[4040231f-6572-4a36-adeb-256cc01cd9f3]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:59 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b Aug 26 12:07:59 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:59 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b" returned: 0 in 0.392s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-cfeb1803-8bb1-4769-94c4-1a02a18c5804-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:59 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 1G Aug 26 12:07:59 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-cfeb1803-8bb1-4769-94c4-1a02a18c5804-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Performing cascade delete. {{(pid=94387) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-38f0829a-539d-4e90-8f0b-f3fade99657c-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-38f0829a-539d-4e90-8f0b-f3fade99657c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-cfeb1803-8bb1-4769-94c4-1a02a18c5804" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-cfeb1803-8bb1-4769-94c4-1a02a18c5804" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-38f0829a-539d-4e90-8f0b-f3fade99657c" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-38f0829a-539d-4e90-8f0b-f3fade99657c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Deleting offline snapshot 38f0829a-539d-4e90-8f0b-f3fade99657c of volume cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] snapshot_file for this snap is: volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2d751a-50f1-418e-9f44-2d2416629aed]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:07:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:07:59 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c Aug 26 12:07:59 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:00 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 1G" returned: 0 in 0.526s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb5e170d-00e1-4631-9d79-05c17509516b -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:00 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb5e170d-00e1-4631-9d79-05c17509516b -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 Aug 26 12:08:00 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:00 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c" returned: 0 in 0.396s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:08:00 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f66354-1da2-4584-9a1c-ea7fbf3a86b1]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:00 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 Aug 26 12:08:00 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:00 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb5e170d-00e1-4631-9d79-05c17509516b -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908" returned: 0 in 0.385s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:00 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 is being set with open permissions: ugo+rw Aug 26 12:08:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:00 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 Aug 26 12:08:00 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:01 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804" returned: 0 in 0.779s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:01 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-15239c3b-b1ad-42a7-ad16-bea7228473df tempest-VolumesTransfersV355Test-903924633 None] Transfer volume completed successfully. Aug 26 12:08:01 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:01 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908" returned: 0 in 0.557s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:01 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:01 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.info Aug 26 12:08:01 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:01 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c" returned: 0 in 0.455s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:01 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.info" returned: 0 in 0.379s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:01 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.info is being set with open permissions: ugo+rw Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:01 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c Aug 26 12:08:01 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:01 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.info Aug 26 12:08:01 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:01 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Acquiring lock "cinder-e0384757-e127-444d-a5c3-9f6e4fef410f-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804.38f0829a-539d-4e90-8f0b-f3fade99657c" returned: 0 in 0.324s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:01 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.info" returned: 0 in 0.337s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-quobyte-3833a77d-f46d-4db2-91a4-ef66df71b5b2" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Lock "cinder-e0384757-e127-444d-a5c3-9f6e4fef410f-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-38f0829a-539d-4e90-8f0b-f3fade99657c" released by "_delete_snapshot" :: held 2.113s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-cfeb1803-8bb1-4769-94c4-1a02a18c5804" released by "delete_snapshot" :: held 2.146s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-3833a77d-f46d-4db2-91a4-ef66df71b5b2" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] snapshot: 48386df9-e36f-4e2c-a820-c362b3bc8908, volume: 3833a77d-f46d-4db2-91a4-ef66df71b5b2, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[60efe321-07d2-47fd-8c2f-120ebcd61c8d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Acquiring lock "cinder-quobyte-e0384757-e127-444d-a5c3-9f6e4fef410f" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Lock "cinder-quobyte-e0384757-e127-444d-a5c3-9f6e4fef410f" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e963709-a08d-4387-a8dd-14ced73b54ce]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Created reservations ['02fff25b-c3cd-4585-aa26-b5a76bfdf187', 'dd9ef1fd-7c4b-4e77-b0ba-06006093b0a1', '6cd6b2aa-e73c-4d92-8ecf-b32e704f55be', 'bdeefaeb-7e78-4b3e-8711-a0a07477f4d9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:02 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 Aug 26 12:08:02 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Delete snapshot completed successfully. Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-38f0829a-539d-4e90-8f0b-f3fade99657c-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Snapshots deleted, issuing volume delete {{(pid=94387) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-cfeb1803-8bb1-4769-94c4-1a02a18c5804" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-cfeb1803-8bb1-4769-94c4-1a02a18c5804" acquired by "delete_volume" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:02 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f Aug 26 12:08:02 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fb6549-3e30-43af-9108-a70393e1fc28]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:02 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 Aug 26 12:08:02 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:02 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908" returned: 0 in 0.461s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb5e170d-00e1-4631-9d79-05c17509516b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41963c7-967b-42cb-b734-b97cf460d0c7]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:02 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f" returned: 0 in 0.472s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:02 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b Aug 26 12:08:02 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:02 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f Aug 26 12:08:02 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:02 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804" returned: 0 in 0.491s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:02 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804 Aug 26 12:08:02 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:02 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b" returned: 0 in 0.437s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:02 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0384757-e127-444d-a5c3-9f6e4fef410f" returned: 0 in 0.374s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:02 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 Aug 26 12:08:02 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Lock "cinder-quobyte-e0384757-e127-444d-a5c3-9f6e4fef410f" released by "delete_volume" :: held 0.940s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Created reservations ['eccb3a9f-0863-48b3-ac30-b5141f0afca7', '74c5c6f1-24f0-47a1-817c-d9d00e66d17a', 'dbea15a5-df15-4447-aa18-f14b3b21d4db', '943ede4b-b163-4c4a-b6f7-a56e256ea6f8'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:03 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cfeb1803-8bb1-4769-94c4-1a02a18c5804" returned: 0 in 0.367s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-cfeb1803-8bb1-4769-94c4-1a02a18c5804" released by "delete_volume" :: held 0.943s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:03 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:03 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Created reservations ['32ea5078-1f6d-4a7a-8ba2-ab05fe7de5f5', 'f119194c-274b-4d2b-8b92-3aad271e8011', '70efba86-7235-4c53-8958-a0cec0acca89', 'ebe2c647-a112-4339-88f7-470f1de5b479'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:03 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:03 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:03 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.411s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:03 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Deleted volume successfully. Aug 26 12:08:03 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.331s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-534285db-4726-425a-be29-dab4b1a16ef4 tempest-VolumesTransfersV355Test-302721577 None] Lock "cinder-e0384757-e127-444d-a5c3-9f6e4fef410f-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:03 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Deleted volume successfully. Aug 26 12:08:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2ded8732-0681-4a88-9ada-135e189c7630 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-cfeb1803-8bb1-4769-94c4-1a02a18c5804-delete_volume" released by "delete_volume" :: held 4.091s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-30686009-286a-4b05-9863-9db5618e702b-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-30686009-286a-4b05-9863-9db5618e702b-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "cinder-quobyte-30686009-286a-4b05-9863-9db5618e702b" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-30686009-286a-4b05-9863-9db5618e702b" acquired by "delete_volume" :: waited 0.052s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d509552a-206d-49ab-875f-571ad04242aa]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:05 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b Aug 26 12:08:05 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Flow 'volume_create_manager' (67d6af04-491d-4ec1-8347-0d2cc746921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61aa97f8-a637-4d8b-8a93-266a733dc11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61aa97f8-a637-4d8b-8a93-266a733dc11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-300915666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f10784-5ee7-42b2-b237-e5b4d6799b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845da4992e884104b3d4370d54f577e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:06Z,use_quota=True,user_id='e016bdd5555c44e4968a12e8e821f635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93076763-a059-4049-9199-b548e7058f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93076763-a059-4049-9199-b548e7058f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ceaf4f-5c8c-49af-871d-aea07c177304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ceaf4f-5c8c-49af-871d-aea07c177304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f10784-5ee7-42b2-b237-e5b4d6799b36', 'volume_name': 'volume-11f10784-5ee7-42b2-b237-e5b4d6799b36', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a66c04-895b-4d0f-98f4-ae566a54d7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a66c04-895b-4d0f-98f4-ae566a54d7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9ad2f1-ddf9-44a7-bc69-a06e9bf753a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:05 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Volume 11f10784-5ee7-42b2-b237-e5b4d6799b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f10784-5ee7-42b2-b237-e5b4d6799b36', 'volume_size': 1} Aug 26 12:08:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:06 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b" returned: 0 in 1.010s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:06 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b Aug 26 12:08:06 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:06 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-30686009-286a-4b05-9863-9db5618e702b" returned: 0 in 0.510s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-quobyte-30686009-286a-4b05-9863-9db5618e702b" released by "delete_volume" :: held 1.670s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Created reservations ['62190a83-ee20-46b3-b201-559e40e2640e', '293d4f2d-310f-45bd-adda-c784de3dfa8f', 'c6fc5b71-22c1-4ec9-be14-94574100a653', 'fd893294-fc9d-4bf6-982a-5087a5c305c6'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:06 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:06 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:07 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.761s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:07 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:07 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Deleted volume successfully. Aug 26 12:08:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4ef75496-1ad5-4959-aac2-ef21b7a39b79 tempest-VolumesDeleteCascade-1365158057 None] Lock "cinder-30686009-286a-4b05-9863-9db5618e702b-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:09 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2" returned: 0 in 6.228s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:08:09 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Converted 1024.00 MB image at 164.40 MB/s Aug 26 12:08:09 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 is being set with open permissions: ugo+rw Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:09 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 Aug 26 12:08:09 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:09 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2" returned: 0 in 0.296s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-3833a77d-f46d-4db2-91a4-ef66df71b5b2" released by "_copy_volume_from_snapshot" :: held 7.518s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-quobyte-48386df9-e36f-4e2c-a820-c362b3bc8908" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-48386df9-e36f-4e2c-a820-c362b3bc8908" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Deleting offline snapshot 48386df9-e36f-4e2c-a820-c362b3bc8908 of volume cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] snapshot_file for this snap is: volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1e9543-fd7e-472d-90c9-53a688e0a0a2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:09 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 Aug 26 12:08:09 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:09 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908" returned: 0 in 0.471s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb5e170d-00e1-4631-9d79-05c17509516b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6869bf-9e70-445b-b685-638b3d514dd4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:10 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b Aug 26 12:08:10 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:10 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:10 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:10 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b" returned: 0 in 0.680s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:10 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 Aug 26 12:08:10 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:10 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.354s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:08:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:08:11 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908" returned: 0 in 0.394s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:11 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908 Aug 26 12:08:11 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:11 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b.48386df9-e36f-4e2c-a820-c362b3bc8908" returned: 0 in 0.259s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-48386df9-e36f-4e2c-a820-c362b3bc8908" released by "_delete_snapshot" :: held 1.934s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=210,cinder:SELECT=169,cinder:INSERT=51,cinder:DELETE=16 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=155,cinder:INSERT=64,cinder:UPDATE=204,cinder:DELETE=19 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.366s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.549s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-300915666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f10784-5ee7-42b2-b237-e5b4d6799b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845da4992e884104b3d4370d54f577e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:06Z,use_quota=True,user_id='e016bdd5555c44e4968a12e8e821f635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Creating volume 11f10784-5ee7-42b2-b237-e5b4d6799b36 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:11 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971ed91a-4410-4e85-8666-6b6019760141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2', 'volume_size': 1, 'source_volid': 'cb5e170d-00e1-4631-9d79-05c17509516b', 'source_volstatus': 'available'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f00f95-d798-4c98-84f8-e2c49f26fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:11 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 1073741824 Aug 26 12:08:11 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:11 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Volume volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 (3833a77d-f46d-4db2-91a4-ef66df71b5b2): created successfully Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f00f95-d798-4c98-84f8-e2c49f26fbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (62dd0b47-43e1-49e0-b1b8-92bfd5a4d784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:11 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-14186424-b246-4604-860f-9749367e18ba tempest-VolumesGetTest-2096632885 None] Created volume successfully. Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Flow 'volume_create_manager' (919bdb81-ac65-48e1-a9a9-18027d865f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bd237a-7353-45b8-a40e-98e891d9b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bd237a-7353-45b8-a40e-98e891d9b3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1181263710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27afd38a-2b07-4e01-8dea-82fa4d126650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27ddb6c55c9e4990a8df6f6e4a58e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:12Z,use_quota=True,user_id='2263fb470d4a4a119de633b938863738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc5590a-dd58-4b83-a139-bd96760d4939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc5590a-dd58-4b83-a139-bd96760d4939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524e6065-b8f0-4574-aab6-d81678758e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524e6065-b8f0-4574-aab6-d81678758e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27afd38a-2b07-4e01-8dea-82fa4d126650', 'volume_name': 'volume-27afd38a-2b07-4e01-8dea-82fa4d126650', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24ab6c7-c6dd-415a-8720-71ec4f28ff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24ab6c7-c6dd-415a-8720-71ec4f28ff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e50a3f-6de7-4b8b-9410-931b36006ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Volume 27afd38a-2b07-4e01-8dea-82fa4d126650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27afd38a-2b07-4e01-8dea-82fa4d126650', 'volume_size': 1} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Flow 'volume_create_manager' (8d84f631-ed78-430e-a53d-9b328541deb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715952d9-944d-4219-899d-54169a05319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715952d9-944d-4219-899d-54169a05319b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1535347948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175af301-ba1b-4ea9-877c-77b76dc4da32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78eff4451afe470abf8b5f2855b27a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:12Z,use_quota=True,user_id='28d7afada034445f88c958ab92dd2a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61986cd-9b19-46a9-9be1-a47b4dff7880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61986cd-9b19-46a9-9be1-a47b4dff7880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990f4192-5df6-4718-a233-e0d9f5c7b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990f4192-5df6-4718-a233-e0d9f5c7b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175af301-ba1b-4ea9-877c-77b76dc4da32', 'volume_name': 'volume-175af301-ba1b-4ea9-877c-77b76dc4da32', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e9454-34c3-4ef7-bbe1-ea860a79ff11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e9454-34c3-4ef7-bbe1-ea860a79ff11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76cd650-7c17-46be-8c55-42b628c4cbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Volume 175af301-ba1b-4ea9-877c-77b76dc4da32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175af301-ba1b-4ea9-877c-77b76dc4da32', 'volume_size': 1} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 1073741824" returned: 0 in 0.631s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:12 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 Aug 26 12:08:12 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:12 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36" returned: 0 in 0.251s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1181263710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27afd38a-2b07-4e01-8dea-82fa4d126650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27ddb6c55c9e4990a8df6f6e4a58e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:12Z,use_quota=True,user_id='2263fb470d4a4a119de633b938863738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Creating volume 27afd38a-2b07-4e01-8dea-82fa4d126650 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:12 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9ad2f1-ddf9-44a7-bc69-a06e9bf753a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f10784-5ee7-42b2-b237-e5b4d6799b36', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bccabb-fd3d-4885-80e9-7954b6d8d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650 1073741824 Aug 26 12:08:12 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:12 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Volume volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 (11f10784-5ee7-42b2-b237-e5b4d6799b36): created successfully Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bccabb-fd3d-4885-80e9-7954b6d8d99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Flow 'volume_create_manager' (67d6af04-491d-4ec1-8347-0d2cc746921c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:12 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-209a7ba7-791a-461f-932f-4766b056ab58 tempest-VolumesTransfersV355Test-2003409352 None] Created volume successfully. Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (e179c5c3-b466-4475-be64-0876a3399dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b72f92a-93fe-4f78-b5a9-29eab8d9d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b72f92a-93fe-4f78-b5a9-29eab8d9d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1742769007',display_name='tempest-VolumesGetTest-Volume-1911799630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00d43f1-33f4-45e6-8183-8db5087375ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:13Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550148fc-6cba-4450-abfb-de142c9e7741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550148fc-6cba-4450-abfb-de142c9e7741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8952078c-8a8c-4201-874f-5967f5877e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8952078c-8a8c-4201-874f-5967f5877e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00d43f1-33f4-45e6-8183-8db5087375ba', 'volume_name': 'volume-f00d43f1-33f4-45e6-8183-8db5087375ba', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24894645-f7a4-4e61-881c-acf2c13850fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24894645-f7a4-4e61-881c-acf2c13850fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8459aa91-acfa-49fd-981c-d6228e3ca5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:12 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Volume f00d43f1-33f4-45e6-8183-8db5087375ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00d43f1-33f4-45e6-8183-8db5087375ba', 'volume_size': 1} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:12 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650 1073741824" returned: 0 in 0.496s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:12 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650 Aug 26 12:08:12 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:13 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650" returned: 0 in 0.252s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.086s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1535347948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175af301-ba1b-4ea9-877c-77b76dc4da32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78eff4451afe470abf8b5f2855b27a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:12Z,use_quota=True,user_id='28d7afada034445f88c958ab92dd2a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Creating volume 175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:13 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Acquiring lock "cinder-11f10784-5ee7-42b2-b237-e5b4d6799b36-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:13 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 1073741824 Aug 26 12:08:13 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e50a3f-6de7-4b8b-9410-931b36006ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27afd38a-2b07-4e01-8dea-82fa4d126650', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3e304b-0d4b-467e-a56c-e7f1617453b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Lock "cinder-11f10784-5ee7-42b2-b237-e5b4d6799b36-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:13 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Volume volume-27afd38a-2b07-4e01-8dea-82fa4d126650 (27afd38a-2b07-4e01-8dea-82fa4d126650): created successfully Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3e304b-0d4b-467e-a56c-e7f1617453b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Flow 'volume_create_manager' (919bdb81-ac65-48e1-a9a9-18027d865f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e6620677-01e4-4c00-836d-8567c7460db8 tempest-VolumesMetadataTest-321516881 None] Created volume successfully. Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Acquiring lock "cinder-quobyte-11f10784-5ee7-42b2-b237-e5b4d6799b36" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Lock "cinder-quobyte-11f10784-5ee7-42b2-b237-e5b4d6799b36" acquired by "delete_volume" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb6952-7cde-4add-93db-c020ab0b2501]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:13 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 Aug 26 12:08:13 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:13 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 1073741824" returned: 0 in 0.460s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:13 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:13 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 Aug 26 12:08:13 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36" returned: 0 in 0.394s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:13 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36 Aug 26 12:08:13 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:13 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32" returned: 0 in 0.265s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.285s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1742769007',display_name='tempest-VolumesGetTest-Volume-1911799630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00d43f1-33f4-45e6-8183-8db5087375ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:13Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Creating volume f00d43f1-33f4-45e6-8183-8db5087375ba {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:14 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:14 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76cd650-7c17-46be-8c55-42b628c4cbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175af301-ba1b-4ea9-877c-77b76dc4da32', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:14 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba 1073741824 Aug 26 12:08:14 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8370a6-a7ef-4b60-8236-38082ff2f77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-11f10784-5ee7-42b2-b237-e5b4d6799b36" returned: 0 in 0.296s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:14 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Volume volume-175af301-ba1b-4ea9-877c-77b76dc4da32 (175af301-ba1b-4ea9-877c-77b76dc4da32): created successfully Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8370a6-a7ef-4b60-8236-38082ff2f77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Flow 'volume_create_manager' (8d84f631-ed78-430e-a53d-9b328541deb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Lock "cinder-quobyte-11f10784-5ee7-42b2-b237-e5b4d6799b36" released by "delete_volume" :: held 0.757s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a0099ecb-40dc-45bc-bb1c-d2a3b84256ce tempest-VolumesActionsTest-1503789506 None] Created volume successfully. Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Created reservations ['f08e4d67-d812-4074-a0bf-edb869f4b59c', '8e5f8cab-b230-4a03-ac23-6022ab13e341', '07a1f5ce-3831-4eb6-8ed2-784a604bc640', 'a7fba53b-6417-4c53-b3aa-c5b40ce767b4'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:14 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:14 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:14 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.318s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:14 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Deleted volume successfully. Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba 1073741824" returned: 0 in 0.593s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Acquiring lock "cinder-27afd38a-2b07-4e01-8dea-82fa4d126650-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1901982b-60fd-4b03-ab0e-a1d682611e9e tempest-VolumesTransfersV355Test-302721577 None] Lock "cinder-11f10784-5ee7-42b2-b237-e5b4d6799b36-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Lock "cinder-27afd38a-2b07-4e01-8dea-82fa4d126650-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:14 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba Aug 26 12:08:14 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Acquiring lock "cinder-quobyte-27afd38a-2b07-4e01-8dea-82fa4d126650" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Lock "cinder-quobyte-27afd38a-2b07-4e01-8dea-82fa4d126650" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba63ab9-82e9-42cf-8eab-a057f3aedf9c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:14 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650 Aug 26 12:08:14 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:14 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba" returned: 0 in 0.308s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8459aa91-acfa-49fd-981c-d6228e3ca5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00d43f1-33f4-45e6-8183-8db5087375ba', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5bbe2a-9285-4cd3-a29d-db89699621ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:15 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Volume volume-f00d43f1-33f4-45e6-8183-8db5087375ba (f00d43f1-33f4-45e6-8183-8db5087375ba): created successfully Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5bbe2a-9285-4cd3-a29d-db89699621ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (e179c5c3-b466-4475-be64-0876a3399dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fd710aad-9f6e-432e-b228-0f867f0a23d8 tempest-VolumesGetTest-2096632885 None] Created volume successfully. Aug 26 12:08:15 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650" returned: 0 in 0.458s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:15 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650 Aug 26 12:08:15 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:15 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-27afd38a-2b07-4e01-8dea-82fa4d126650" returned: 0 in 0.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Lock "cinder-quobyte-27afd38a-2b07-4e01-8dea-82fa4d126650" released by "delete_volume" :: held 0.795s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Created reservations ['9ce211de-1598-473e-896c-1d8c6a94eb14', 'f7bfdad8-670a-4b8d-9fef-3a8b7c1e46cb', '80c6538a-3b8b-45ee-bd4f-0b2830e094ac', 'ccab5c50-59e3-4b72-b8ee-60aa1a7a626d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:15 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:15 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-f00d43f1-33f4-45e6-8183-8db5087375ba-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Lock "cinder-f00d43f1-33f4-45e6-8183-8db5087375ba-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-quobyte-f00d43f1-33f4-45e6-8183-8db5087375ba" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:16 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.460s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Deleted volume successfully. Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-f00d43f1-33f4-45e6-8183-8db5087375ba" acquired by "delete_volume" :: waited 0.047s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2e6603f7-7a3b-4228-9d40-76c83fc794c8 tempest-VolumesMetadataTest-321516881 None] Lock "cinder-27afd38a-2b07-4e01-8dea-82fa4d126650-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c0ea4-a306-4b38-ba50-d16d0611ba13]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:16 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba Aug 26 12:08:16 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:16 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba" returned: 0 in 0.477s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:16 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba Aug 26 12:08:16 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:17 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f00d43f1-33f4-45e6-8183-8db5087375ba" returned: 0 in 0.351s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-f00d43f1-33f4-45e6-8183-8db5087375ba" released by "delete_volume" :: held 0.919s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Created reservations ['3f87454e-3737-41db-a792-1f10e010bd26', 'ba6d1a5a-94d4-4c42-b78d-57009156b1c0', 'fdf0b339-8a3f-4c52-96c2-0cc61f4416b0', '96306e77-1080-475d-85e7-fb3ea2c17d49'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:17 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:17 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:17 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.325s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:17 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Deleted volume successfully. Aug 26 12:08:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-280449f9-e665-4486-95cd-9d388ddd1396 tempest-VolumesGetTest-2096632885 None] Lock "cinder-f00d43f1-33f4-45e6-8183-8db5087375ba-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-3833a77d-f46d-4db2-91a4-ef66df71b5b2-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Lock "cinder-3833a77d-f46d-4db2-91a4-ef66df71b5b2-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-quobyte-3833a77d-f46d-4db2-91a4-ef66df71b5b2" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-3833a77d-f46d-4db2-91a4-ef66df71b5b2" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:18 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed109f6a-57b3-461d-b456-0db668c6a5aa]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:18 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 Aug 26 12:08:18 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:19 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2" returned: 0 in 0.598s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:19 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2 Aug 26 12:08:19 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:19 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3833a77d-f46d-4db2-91a4-ef66df71b5b2" returned: 0 in 0.331s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-3833a77d-f46d-4db2-91a4-ef66df71b5b2" released by "delete_volume" :: held 1.017s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Created reservations ['754a0061-2fca-451b-bfe5-82b6bf3a8296', 'd975189d-3d33-426a-bf93-026c35a78152', 'a88de548-a74e-4a0b-811d-4ed43a1d5ab3', 'b60259d0-6d55-46be-b87f-804e853037ac'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:19 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:19 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:20 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.302s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:20 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:20 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Deleted volume successfully. Aug 26 12:08:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-86f7310c-8021-4c1d-ba0d-91796afdce29 tempest-VolumesGetTest-2096632885 None] Lock "cinder-3833a77d-f46d-4db2-91a4-ef66df71b5b2-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-cb5e170d-00e1-4631-9d79-05c17509516b-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Lock "cinder-cb5e170d-00e1-4631-9d79-05c17509516b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-quobyte-cb5e170d-00e1-4631-9d79-05c17509516b" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-cb5e170d-00e1-4631-9d79-05c17509516b" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:21 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b225f2-37d1-4869-bd5f-9dd2a967511c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:21 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b Aug 26 12:08:21 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:21 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b" returned: 0 in 0.568s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:21 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b Aug 26 12:08:21 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:22 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-cb5e170d-00e1-4631-9d79-05c17509516b" returned: 0 in 0.494s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-cb5e170d-00e1-4631-9d79-05c17509516b" released by "delete_volume" :: held 1.168s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Created reservations ['97a8079d-35fc-40f8-a7f5-08ab2a7b7929', '63487ea4-eedb-473d-8596-38d910ab3257', '06bc163f-f0d3-4ff2-beea-678c007b3a26', '1a533590-0dbb-4e99-b29b-ac669e0498b9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:22 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:22 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:22 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.360s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:22 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Deleted volume successfully. Aug 26 12:08:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-143091fd-b0dd-4a00-a536-31bb668a6176 tempest-VolumesGetTest-2096632885 None] Lock "cinder-cb5e170d-00e1-4631-9d79-05c17509516b-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Flow 'volume_create_manager' (61e1e509-2e9e-4060-aafd-b3dfe97f7eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cd7881-e86e-4419-8247-10744149c7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cd7881-e86e-4419-8247-10744149c7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-157040074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73e275a-34f5-4fa4-88b3-59e43d3a9b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5a0ef916f24164a2c5d7b328b6b025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:24Z,use_quota=True,user_id='0e2a7181a7c0414db0abc2203611ff0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd1491b-a166-4abd-aeb8-634de7cb7fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd1491b-a166-4abd-aeb8-634de7cb7fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43237c03-8846-4034-a058-3202d668e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43237c03-8846-4034-a058-3202d668e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73e275a-34f5-4fa4-88b3-59e43d3a9b93', 'volume_name': 'volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb54502-94cd-4e71-90aa-57502cd52304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb54502-94cd-4e71-90aa-57502cd52304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3590241c-71c2-447c-b6eb-85585dddb1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:23 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Volume b73e275a-34f5-4fa4-88b3-59e43d3a9b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93', 'volume_size': 1} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-157040074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73e275a-34f5-4fa4-88b3-59e43d3a9b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5a0ef916f24164a2c5d7b328b6b025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:24Z,use_quota=True,user_id='0e2a7181a7c0414db0abc2203611ff0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Creating volume b73e275a-34f5-4fa4-88b3-59e43d3a9b93 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:23 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:23 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 1073741824 Aug 26 12:08:23 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Flow 'volume_create_manager' (33fdb6ac-46ba-4430-86f8-3600e1f586f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb2daf3-c368-483f-9297-ae9be144a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb2daf3-c368-483f-9297-ae9be144a640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1465795543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537fa94a-3d29-493a-9510-2bfba9b980e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5173b1ddd49dbb223ba0e7638c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:24Z,use_quota=True,user_id='0dfc112b622848a19585a7a5cc561967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac97f33-cac7-4fb5-ad4e-1c794da2df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac97f33-cac7-4fb5-ad4e-1c794da2df6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7612a08d-54c4-4d9c-9d71-b50b2877f415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:08:24 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 1073741824" returned: 0 in 0.774s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:24 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 Aug 26 12:08:24 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7612a08d-54c4-4d9c-9d71-b50b2877f415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '537fa94a-3d29-493a-9510-2bfba9b980e9', 'volume_name': 'volume-537fa94a-3d29-493a-9510-2bfba9b980e9', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eacbdd2-19e8-471b-b4af-da0810481048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eacbdd2-19e8-471b-b4af-da0810481048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffe8e75-0a09-4851-b74a-403a3a374bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:24 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Volume 537fa94a-3d29-493a-9510-2bfba9b980e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-537fa94a-3d29-493a-9510-2bfba9b980e9', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 12:08:24 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Trying to clone 537fa94a-3d29-493a-9510-2bfba9b980e9 from image 014b1010-45ca-42a7-a54b-7655e36f8066 at location (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:08:25 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93" returned: 0 in 0.560s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3590241c-71c2-447c-b6eb-85585dddb1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1582f157-5ac2-4d87-be85-56d8ef7c2b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (d7970abd-e6d4-4a83-b766-836f89ccd26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a602fa7-d893-4499-bc8b-8cbe6560172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:25 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Volume volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 (b73e275a-34f5-4fa4-88b3-59e43d3a9b93): created successfully Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1582f157-5ac2-4d87-be85-56d8ef7c2b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Flow 'volume_create_manager' (61e1e509-2e9e-4060-aafd-b3dfe97f7eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a602fa7-d893-4499-bc8b-8cbe6560172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1143279337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a86a614-58b4-4b62-abb6-8efcce521b30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:25Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54bbf36-0b99-42c7-b1f0-66ed3eb63358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54bbf36-0b99-42c7-b1f0-66ed3eb63358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d713e117-aaf1-44e9-a1c9-7af2c4a3585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7cad0735-309b-4ba0-88a8-76db26b87a72 tempest-VolumesActionsTest-1503789506 None] Acquiring lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32" by "attach_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-37794c7c-e157-45ef-ba41-2c3cd68e2dab tempest-VolumesTransfersTest-116306407 None] Created volume successfully. Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7cad0735-309b-4ba0-88a8-76db26b87a72 tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32" acquired by "attach_volume" :: waited 0.050s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:08:25 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Image download 20.69 MB at 20.69 MB/s Aug 26 12:08:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7cad0735-309b-4ba0-88a8-76db26b87a72 tempest-VolumesActionsTest-1503789506 None] Attaching volume 175af301-ba1b-4ea9-877c-77b76dc4da32 to instance b136c1ba-07ed-4b56-84a4-fa1692e48761 at mountpoint /dev/vdb on host None. Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0b437d-864e-442f-ad16-986976870853]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7cad0735-309b-4ba0-88a8-76db26b87a72 tempest-VolumesActionsTest-1503789506 None] Attach volume completed successfully. Aug 26 12:08:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7cad0735-309b-4ba0-88a8-76db26b87a72 tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32" released by "attach_volume" :: held 0.304s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:26 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD Aug 26 12:08:26 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d713e117-aaf1-44e9-a1c9-7af2c4a3585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a86a614-58b4-4b62-abb6-8efcce521b30', 'volume_name': 'volume-5a86a614-58b4-4b62-abb6-8efcce521b30', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1a0a70-117e-44d7-95d4-808840afbae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1a0a70-117e-44d7-95d4-808840afbae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c3b0ce-a4fc-4833-8289-923473672a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:26 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Volume 5a86a614-58b4-4b62-abb6-8efcce521b30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a86a614-58b4-4b62-abb6-8efcce521b30', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Trying to clone 5a86a614-58b4-4b62-abb6-8efcce521b30 from image 014b1010-45ca-42a7-a54b-7655e36f8066 at location (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0fdc43f4-3a62-4da6-9f55-fba1c97d631c tempest-VolumesActionsTest-1503789506 None] Acquiring lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32-detach_volume" by "detach_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0fdc43f4-3a62-4da6-9f55-fba1c97d631c tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:26 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0fdc43f4-3a62-4da6-9f55-fba1c97d631c tempest-VolumesActionsTest-1503789506 None] Detaching volume 175af301-ba1b-4ea9-877c-77b76dc4da32 from instance b136c1ba-07ed-4b56-84a4-fa1692e48761. Aug 26 12:08:26 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 is fetched for user 0dfc112b622848a19585a7a5cc561967. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:08:26 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0fdc43f4-3a62-4da6-9f55-fba1c97d631c tempest-VolumesActionsTest-1503789506 None] Detach volume completed successfully. Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0fdc43f4-3a62-4da6-9f55-fba1c97d631c tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32-detach_volume" released by "detach_volume" :: held 0.273s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f5ea7-6c61-4a6a-8a9f-ec6feabb660c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:08:26 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Image download 20.69 MB at 20.69 MB/s Aug 26 12:08:26 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD Aug 26 12:08:26 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90d4e84-d598-4b94-a1b9-5e35b889cecc]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:27 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD Aug 26 12:08:27 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5da995f7-043d-4f46-bbb6-76295e537d6a tempest-VolumesTransfersTest-994794815 None] Transfer volume completed successfully. Aug 26 12:08:27 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD" returned: 0 in 0.744s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1465795543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537fa94a-3d29-493a-9510-2bfba9b980e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5173b1ddd49dbb223ba0e7638c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:24Z,use_quota=True,user_id='0dfc112b622848a19585a7a5cc561967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Creating volume 537fa94a-3d29-493a-9510-2bfba9b980e9 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:27 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:27 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 1073741824 Aug 26 12:08:27 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:27 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD" returned: 0 in 0.596s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 is fetched for user e1be6581e86e45bf9e5ddbdd9e56088c. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[807d522e-c965-420e-ba37-b4ba2e55c950]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:27 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD Aug 26 12:08:27 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Acquiring lock "cinder-b73e275a-34f5-4fa4-88b3-59e43d3a9b93-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Lock "cinder-b73e275a-34f5-4fa4-88b3-59e43d3a9b93-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Acquiring lock "cinder-quobyte-b73e275a-34f5-4fa4-88b3-59e43d3a9b93" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Lock "cinder-quobyte-b73e275a-34f5-4fa4-88b3-59e43d3a9b93" acquired by "delete_volume" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe02af66-6e55-495d-aac3-2eab998bf810]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:28 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:28 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 1073741824" returned: 0 in 0.808s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:28 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:28 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:28 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 Aug 26 12:08:28 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:28 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93" returned: 0 in 0.440s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:28 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93 Aug 26 12:08:28 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:28 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9" returned: 0 in 0.368s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1143279337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a86a614-58b4-4b62-abb6-8efcce521b30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:25Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Creating volume 5a86a614-58b4-4b62-abb6-8efcce521b30 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:28 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Attempting download of 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume 537fa94a-3d29-493a-9510-2bfba9b980e9. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:08:28 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 1073741824 Aug 26 12:08:28 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[19323206-5dff-4fbf-8bc7-20c5d58bec8a]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5dh5vzkb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:28 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b73e275a-34f5-4fa4-88b3-59e43d3a9b93" returned: 0 in 0.378s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Lock "cinder-quobyte-b73e275a-34f5-4fa4-88b3-59e43d3a9b93" released by "delete_volume" :: held 0.875s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:28 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Created reservations ['708dc2a9-71ff-4b47-a136-62fcb15a1ec6', '27a3eca0-7c47-400f-9d8d-29a38842217d', 'b7f27b30-6ed5-4d42-bc4e-4da3506328b5', '09cfeb37-c0ac-417f-945f-0add27c606b3'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:28 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5dh5vzkb Aug 26 12:08:28 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:29 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:29 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:29 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5dh5vzkb" returned: 0 in 0.440s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5dh5vzkb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:29 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 1073741824" returned: 0 in 0.755s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:29 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.398s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:29 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5dh5vzkb Aug 26 12:08:29 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:29 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Deleted volume successfully. Aug 26 12:08:29 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 Aug 26 12:08:29 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4e96dd3b-e66c-4838-9fd3-1887de590e14 tempest-VolumesTransfersTest-183335772 None] Lock "cinder-b73e275a-34f5-4fa4-88b3-59e43d3a9b93-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:29 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5dh5vzkb" returned: 1 in 0.509s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_5dh5vzkb' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3225d510-b9e2-4990-a937-97edbf6d7088]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:29 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Flow 'volume_create_manager' (4dd9a23b-a3a6-4212-a7cd-a7c0f4da6d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbd3d7d-a83a-40ca-bbdd-3d29c48f7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30" returned: 0 in 0.413s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbd3d7d-a83a-40ca-bbdd-3d29c48f7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1403341855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051f16d9-db36-43aa-b181-886a1be61e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5a0ef916f24164a2c5d7b328b6b025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:30Z,use_quota=True,user_id='0e2a7181a7c0414db0abc2203611ff0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a757433-0cd6-497b-a4c9-093d04c9fec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a757433-0cd6-497b-a4c9-093d04c9fec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c682c7-1027-4b0a-86f8-2584e222377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c682c7-1027-4b0a-86f8-2584e222377e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051f16d9-db36-43aa-b181-886a1be61e39', 'volume_name': 'volume-051f16d9-db36-43aa-b181-886a1be61e39', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba9b369-b58a-4d40-ac7e-8d6229e1e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba9b369-b58a-4d40-ac7e-8d6229e1e961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:29 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD Aug 26 12:08:29 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206668e8-1a7a-45e5-8607-20c4d3b114c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:29 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Volume 051f16d9-db36-43aa-b181-886a1be61e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051f16d9-db36-43aa-b181-886a1be61e39', 'volume_size': 1} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1403341855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051f16d9-db36-43aa-b181-886a1be61e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5a0ef916f24164a2c5d7b328b6b025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:30Z,use_quota=True,user_id='0e2a7181a7c0414db0abc2203611ff0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Creating volume 051f16d9-db36-43aa-b181-886a1be61e39 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:29 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:29 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39 1073741824 Aug 26 12:08:29 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:29 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Attempting download of 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume 5a86a614-58b4-4b62-abb6-8efcce521b30. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c46c2d2-a011-436c-9910-8fbab3d7eb84]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_ehfa2601 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:30 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_ehfa2601 Aug 26 12:08:30 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:30 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] 014b1010-45ca-42a7-a54b-7655e36f8066 was qcow2, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:30 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 Aug 26 12:08:30 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:30 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39 1073741824" returned: 0 in 0.577s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:30 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_ehfa2601" returned: 0 in 0.495s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_ehfa2601 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:30 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39 Aug 26 12:08:30 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:30 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_ehfa2601 Aug 26 12:08:30 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:30 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39" returned: 0 in 0.302s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206668e8-1a7a-45e5-8607-20c4d3b114c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051f16d9-db36-43aa-b181-886a1be61e39', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08e507f-b994-4963-bcbc-23d0e5edeef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:30 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:30 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Volume volume-051f16d9-db36-43aa-b181-886a1be61e39 (051f16d9-db36-43aa-b181-886a1be61e39): created successfully Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08e507f-b994-4963-bcbc-23d0e5edeef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Flow 'volume_create_manager' (4dd9a23b-a3a6-4212-a7cd-a7c0f4da6d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_ehfa2601" returned: 1 in 0.444s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_ehfa2601' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90a5f54-fe70-4f53-aaed-5beea7b6dec2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b35b8e2d-fd0a-4861-acc0-3e14e62f66bc tempest-VolumesTransfersTest-116306407 None] Created volume successfully. Aug 26 12:08:31 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD Aug 26 12:08:31 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:31 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:31 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] 014b1010-45ca-42a7-a54b-7655e36f8066 was qcow2, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:08:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:31 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 Aug 26 12:08:31 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Acquiring lock "cinder-051f16d9-db36-43aa-b181-886a1be61e39-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Lock "cinder-051f16d9-db36-43aa-b181-886a1be61e39-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Acquiring lock "cinder-quobyte-051f16d9-db36-43aa-b181-886a1be61e39" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Lock "cinder-quobyte-051f16d9-db36-43aa-b181-886a1be61e39" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:32 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9" returned: 0 in 2.225s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_86cl1rb9devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:08:32 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Converted 112.00 MB image at 50.30 MB/s Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[198d19ec-296f-4bed-ab62-965367d23d95]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:32 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 1G Aug 26 12:08:32 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:32 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39 Aug 26 12:08:32 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:32 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39" returned: 0 in 0.561s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:32 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 1G" returned: 0 in 0.597s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:32 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Downloaded image 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume 537fa94a-3d29-493a-9510-2bfba9b980e9 successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 for user 0dfc112b622848a19585a7a5cc561967 is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Marking volume 537fa94a-3d29-493a-9510-2bfba9b980e9 as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Copying metadata from image 014b1010-45ca-42a7-a54b-7655e36f8066 to 537fa94a-3d29-493a-9510-2bfba9b980e9. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Creating volume glance metadata for volume 537fa94a-3d29-493a-9510-2bfba9b980e9 backed by image 014b1010-45ca-42a7-a54b-7655e36f8066 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:08:33 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39 Aug 26 12:08:33 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffe8e75-0a09-4851-b74a-403a3a374bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537fa94a-3d29-493a-9510-2bfba9b980e9', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0648f497-3411-4b4a-bb79-2a589b35df4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:33 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Volume volume-537fa94a-3d29-493a-9510-2bfba9b980e9 (537fa94a-3d29-493a-9510-2bfba9b980e9): created successfully Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0648f497-3411-4b4a-bb79-2a589b35df4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Flow 'volume_create_manager' (33fdb6ac-46ba-4430-86f8-3600e1f586f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:33 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f4314c9a-ef74-4843-8668-9ebe769e29d1 tempest-VolumesExtendTest-106882959 None] Created volume successfully. Aug 26 12:08:33 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-051f16d9-db36-43aa-b181-886a1be61e39" returned: 0 in 0.481s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Lock "cinder-quobyte-051f16d9-db36-43aa-b181-886a1be61e39" released by "delete_volume" :: held 1.137s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Created reservations ['b9015253-b3a9-4b63-8211-c88a6a907f75', 'ca60266f-01c3-4dd9-ae87-3e90d8d4b48c', '1a7cce2e-4388-440e-a2ec-0169088e05a8', 'e0aa654b-568c-4478-a274-c1d13ea67704'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:33 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:33 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:34 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30" returned: 0 in 2.671s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_4v0lovyedevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:08:34 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Converted 112.00 MB image at 41.90 MB/s Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:34 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 1G Aug 26 12:08:34 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:34 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.348s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Deleted volume successfully. Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aaa3916e-680d-497f-89d3-e61f6ce5b7f0 tempest-VolumesTransfersTest-183335772 None] Lock "cinder-051f16d9-db36-43aa-b181-886a1be61e39-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-963e2cf9-77d0-458e-a6d9-dd4129493ab5 tempest-VolumesExtendTest-106882959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-963e2cf9-77d0-458e-a6d9-dd4129493ab5 tempest-VolumesExtendTest-106882959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0ee33a-0358-4c30-9294-96dd74624981]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-963e2cf9-77d0-458e-a6d9-dd4129493ab5 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:34 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 Aug 26 12:08:34 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:34 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 1G" returned: 0 in 0.385s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Downloaded image 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume 5a86a614-58b4-4b62-abb6-8efcce521b30 successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 for user e1be6581e86e45bf9e5ddbdd9e56088c is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Marking volume 5a86a614-58b4-4b62-abb6-8efcce521b30 as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Copying metadata from image 014b1010-45ca-42a7-a54b-7655e36f8066 to 5a86a614-58b4-4b62-abb6-8efcce521b30. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Creating volume glance metadata for volume 5a86a614-58b4-4b62-abb6-8efcce521b30 backed by image 014b1010-45ca-42a7-a54b-7655e36f8066 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c3b0ce-a4fc-4833-8289-923473672a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a86a614-58b4-4b62-abb6-8efcce521b30', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9022889-9908-4265-8228-6c9b14b4531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:34 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Volume volume-5a86a614-58b4-4b62-abb6-8efcce521b30 (5a86a614-58b4-4b62-abb6-8efcce521b30): created successfully Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9022889-9908-4265-8228-6c9b14b4531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (d7970abd-e6d4-4a83-b766-836f89ccd26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-16068014-0d50-4a49-bd66-0e4a6207644f tempest-VolumesGetTest-2096632885 None] Created volume successfully. Aug 26 12:08:34 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-963e2cf9-77d0-458e-a6d9-dd4129493ab5 tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9" returned: 0 in 0.489s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-963e2cf9-77d0-458e-a6d9-dd4129493ab5 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 2G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-963e2cf9-77d0-458e-a6d9-dd4129493ab5 tempest-VolumesExtendTest-106882959 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 2G" returned: 0 in 0.138s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-963e2cf9-77d0-458e-a6d9-dd4129493ab5 tempest-VolumesExtendTest-106882959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.660s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-963e2cf9-77d0-458e-a6d9-dd4129493ab5 tempest-VolumesExtendTest-106882959 None] Extend volume completed successfully. Aug 26 12:08:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Acquiring lock "cinder-537fa94a-3d29-493a-9510-2bfba9b980e9-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Lock "cinder-537fa94a-3d29-493a-9510-2bfba9b980e9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Acquiring lock "cinder-quobyte-537fa94a-3d29-493a-9510-2bfba9b980e9" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Lock "cinder-quobyte-537fa94a-3d29-493a-9510-2bfba9b980e9" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a144cae-2bf3-4930-b98a-ab5326be075f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:35 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 Aug 26 12:08:35 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:35 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (317dacbc-d8d3-456a-bf12-c3c6b4ea6175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1448d844-465c-4bbd-a6a9-f60df2fcee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1448d844-465c-4bbd-a6a9-f60df2fcee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1945807736',display_name='tempest-VolumesGetTest-Volume-1673382033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68668517-eb3f-4cdd-9059-45c2db0ea537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:36Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c041582-fd98-46e0-92ac-d05274720b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c041582-fd98-46e0-92ac-d05274720b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89536b54-6781-43ba-b291-e3c2ae35eeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89536b54-6781-43ba-b291-e3c2ae35eeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68668517-eb3f-4cdd-9059-45c2db0ea537', 'volume_name': 'volume-68668517-eb3f-4cdd-9059-45c2db0ea537', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bff82d-004a-41cc-80bd-073b270f7b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bff82d-004a-41cc-80bd-073b270f7b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ac248d-8fa7-4c03-9d01-c0c93bdd9c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Volume 68668517-eb3f-4cdd-9059-45c2db0ea537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68668517-eb3f-4cdd-9059-45c2db0ea537', 'volume_size': 1} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1945807736',display_name='tempest-VolumesGetTest-Volume-1673382033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68668517-eb3f-4cdd-9059-45c2db0ea537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ecb50bb664fa28c90a9f1728ffe92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:36Z,use_quota=True,user_id='e1be6581e86e45bf9e5ddbdd9e56088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Creating volume 68668517-eb3f-4cdd-9059-45c2db0ea537 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:36 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:36 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9" returned: 0 in 0.606s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:36 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537 1073741824 Aug 26 12:08:36 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:36 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9 Aug 26 12:08:36 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:36 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-537fa94a-3d29-493a-9510-2bfba9b980e9" returned: 0 in 0.624s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Lock "cinder-quobyte-537fa94a-3d29-493a-9510-2bfba9b980e9" released by "delete_volume" :: held 1.316s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Created reservations ['993fcab2-681c-47e4-9462-f11bc104230c', '3184bd4d-3e2a-4d70-910b-d00d890daa53', '6f7438a9-67f8-4b4a-befd-1a6ea2496892', '617557c8-2b01-45fe-8c5e-c8c18fd976a9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:37 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:37 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:37 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537 1073741824" returned: 0 in 1.048s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:37 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537 Aug 26 12:08:37 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:37 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.382s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:37 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Deleted volume successfully. Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-418850c6-0df1-4b0f-9820-b53b301cb92b tempest-VolumesExtendTest-106882959 None] Lock "cinder-537fa94a-3d29-493a-9510-2bfba9b980e9-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:37 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537" returned: 0 in 0.390s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ac248d-8fa7-4c03-9d01-c0c93bdd9c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68668517-eb3f-4cdd-9059-45c2db0ea537', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da2886e-3d57-455d-bb3d-e35172afb5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:37 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Volume volume-68668517-eb3f-4cdd-9059-45c2db0ea537 (68668517-eb3f-4cdd-9059-45c2db0ea537): created successfully Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da2886e-3d57-455d-bb3d-e35172afb5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Flow 'volume_create_manager' (317dacbc-d8d3-456a-bf12-c3c6b4ea6175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:37 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-bfb9ae21-af46-4dec-bc22-b18413c1f3b6 tempest-VolumesGetTest-2096632885 None] Created volume successfully. Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-68668517-eb3f-4cdd-9059-45c2db0ea537-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Lock "cinder-68668517-eb3f-4cdd-9059-45c2db0ea537-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-quobyte-68668517-eb3f-4cdd-9059-45c2db0ea537" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-68668517-eb3f-4cdd-9059-45c2db0ea537" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b48d7-4177-4c91-824b-40e81c8e81bf]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:38 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537 Aug 26 12:08:38 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Flow 'volume_create_manager' (f37f62ac-4b9c-4140-9cca-8e4c5496fa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598cf6b1-3e89-4de0-9aea-3e113c04580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598cf6b1-3e89-4de0-9aea-3e113c04580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1975711376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a16e757-3d1b-48a5-8675-ba9410b54c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5173b1ddd49dbb223ba0e7638c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:39Z,use_quota=True,user_id='0dfc112b622848a19585a7a5cc561967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5e5fee-dd4f-4e4a-83b8-d88a57be826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5e5fee-dd4f-4e4a-83b8-d88a57be826f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563fad5f-a236-40f5-8283-bed73c40e05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563fad5f-a236-40f5-8283-bed73c40e05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a16e757-3d1b-48a5-8675-ba9410b54c30', 'volume_name': 'volume-6a16e757-3d1b-48a5-8675-ba9410b54c30', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2695fa2c-0a38-4a4b-9edf-b82c2df102d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2695fa2c-0a38-4a4b-9edf-b82c2df102d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17a1cdf-b7e5-458a-9ef2-e50af1077148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:38 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Volume 6a16e757-3d1b-48a5-8675-ba9410b54c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a16e757-3d1b-48a5-8675-ba9410b54c30', 'volume_size': 1} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1975711376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a16e757-3d1b-48a5-8675-ba9410b54c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5173b1ddd49dbb223ba0e7638c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:08:39Z,use_quota=True,user_id='0dfc112b622848a19585a7a5cc561967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Creating volume 6a16e757-3d1b-48a5-8675-ba9410b54c30 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:08:38 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:08:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:39 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 1073741824 Aug 26 12:08:39 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:39 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537" returned: 0 in 0.503s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:39 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537 Aug 26 12:08:39 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:39 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-68668517-eb3f-4cdd-9059-45c2db0ea537" returned: 0 in 0.587s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-68668517-eb3f-4cdd-9059-45c2db0ea537" released by "delete_volume" :: held 1.175s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Created reservations ['a52099c6-d060-4092-9855-aa8a21e3317a', 'e7d57d93-179a-4822-a375-94005bb57fa4', 'afd75571-17aa-400e-9ae6-ffc173a217ee', '081994aa-2f18-4b88-a0fe-edd97867d00f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:39 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 1073741824" returned: 0 in 0.973s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:39 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:39 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:40 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 Aug 26 12:08:40 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:40 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.378s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Deleted volume successfully. Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-17d1edc1-e4c5-4b78-b71d-2ff80a8e1a16 tempest-VolumesGetTest-2096632885 None] Lock "cinder-68668517-eb3f-4cdd-9059-45c2db0ea537-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:40 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30" returned: 0 in 0.352s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17a1cdf-b7e5-458a-9ef2-e50af1077148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a16e757-3d1b-48a5-8675-ba9410b54c30', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39d3083-b940-4e79-9162-ec805071c2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:08:40 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Volume volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 (6a16e757-3d1b-48a5-8675-ba9410b54c30): created successfully Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39d3083-b940-4e79-9162-ec805071c2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Flow 'volume_create_manager' (f37f62ac-4b9c-4140-9cca-8e4c5496fa7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:08:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-813c32f3-28d0-4677-a867-b95e0870d773 tempest-VolumesExtendTest-106882959 None] Created volume successfully. Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-5a86a614-58b4-4b62-abb6-8efcce521b30-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Lock "cinder-5a86a614-58b4-4b62-abb6-8efcce521b30-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Acquiring lock "cinder-quobyte-5a86a614-58b4-4b62-abb6-8efcce521b30" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-5a86a614-58b4-4b62-abb6-8efcce521b30" acquired by "delete_volume" :: waited 0.033s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f85ecc-2929-4308-a331-4ceb72a6a683]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:41 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 Aug 26 12:08:41 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-058e9319-fc6f-4bd1-840d-4396734117f1 tempest-VolumesActionsTest-1503789506 None] Acquiring lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32" by "attach_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-058e9319-fc6f-4bd1-840d-4396734117f1 tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32" acquired by "attach_volume" :: waited 0.046s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Creating offline snapshot e9fbe649-8eaf-4982-86ba-c11402264531 of volume 6a16e757-3d1b-48a5-8675-ba9410b54c30 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[031d0b19-1760-4f62-afe2-f1817171265c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:41 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-058e9319-fc6f-4bd1-840d-4396734117f1 tempest-VolumesActionsTest-1503789506 None] Attaching volume 175af301-ba1b-4ea9-877c-77b76dc4da32 to instance e2c7d7cc-6d0f-4a19-86bd-db38fad5df0a at mountpoint /dev/vdb on host None. Aug 26 12:08:41 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-058e9319-fc6f-4bd1-840d-4396734117f1 tempest-VolumesActionsTest-1503789506 None] Attach volume completed successfully. Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-058e9319-fc6f-4bd1-840d-4396734117f1 tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32" released by "attach_volume" :: held 0.224s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:41 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 Aug 26 12:08:41 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:41 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30" returned: 0 in 0.625s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:41 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30 Aug 26 12:08:41 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b91f65eb-4871-47fe-ba31-d5a5ed032dda tempest-VolumesActionsTest-1503789506 None] Acquiring lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32-detach_volume" by "detach_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b91f65eb-4871-47fe-ba31-d5a5ed032dda tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:42 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b91f65eb-4871-47fe-ba31-d5a5ed032dda tempest-VolumesActionsTest-1503789506 None] Detaching volume 175af301-ba1b-4ea9-877c-77b76dc4da32 from instance e2c7d7cc-6d0f-4a19-86bd-db38fad5df0a. Aug 26 12:08:42 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30" returned: 0 in 0.595s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:42 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 1G Aug 26 12:08:42 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:42 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b91f65eb-4871-47fe-ba31-d5a5ed032dda tempest-VolumesActionsTest-1503789506 None] Detach volume completed successfully. Aug 26 12:08:42 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b91f65eb-4871-47fe-ba31-d5a5ed032dda tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32-detach_volume" released by "detach_volume" :: held 0.152s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5a86a614-58b4-4b62-abb6-8efcce521b30" returned: 0 in 0.454s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Lock "cinder-quobyte-5a86a614-58b4-4b62-abb6-8efcce521b30" released by "delete_volume" :: held 1.162s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Created reservations ['9b9a6aa0-48da-45a3-b9d5-67415b3011d4', '5c4b0eb4-e982-470d-9847-55fd5ef8f7e5', '1a4bb250-0340-466e-8a6a-4f0e2b9634ad', '9d15e936-d69f-40dd-9d56-37ee3fd67379'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:42 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:42 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:42 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 1G" returned: 0 in 0.778s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:42 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 Aug 26 12:08:42 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:42 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.543s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:42 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:42 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Deleted volume successfully. Aug 26 12:08:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e7226b5b-0395-4a3c-bafe-ab0aa972973d tempest-VolumesGetTest-2096632885 None] Lock "cinder-5a86a614-58b4-4b62-abb6-8efcce521b30-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:43 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531" returned: 0 in 0.502s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:43 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 is being set with open permissions: ugo+rw Aug 26 12:08:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:43 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 Aug 26 12:08:43 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:43 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531" returned: 0 in 0.425s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:43 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.info Aug 26 12:08:43 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:44 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.info" returned: 0 in 0.367s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:44 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.info is being set with open permissions: ugo+rw Aug 26 12:08:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:44 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.info Aug 26 12:08:44 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:44 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.info" returned: 0 in 0.284s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.112s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3f2debb3-3254-4b8e-98a3-55f7308ed05e tempest-VolumesExtendTest-106882959 None] Create snapshot completed successfully Aug 26 12:08:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c46172ab-81f7-4d61-b124-8114d89c784d tempest-VolumesExtendTest-106882959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c46172ab-81f7-4d61-b124-8114d89c784d tempest-VolumesExtendTest-106882959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:45 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1347818-772a-4850-ab7c-ab3616b44139]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c46172ab-81f7-4d61-b124-8114d89c784d tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:45 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 Aug 26 12:08:45 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:46 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c46172ab-81f7-4d61-b124-8114d89c784d tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30" returned: 0 in 0.443s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c46172ab-81f7-4d61-b124-8114d89c784d tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 2G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c46172ab-81f7-4d61-b124-8114d89c784d tempest-VolumesExtendTest-106882959 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 2G" returned: 0 in 0.213s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c46172ab-81f7-4d61-b124-8114d89c784d tempest-VolumesExtendTest-106882959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.708s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c46172ab-81f7-4d61-b124-8114d89c784d tempest-VolumesExtendTest-106882959 None] Extend volume completed successfully. Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Acquiring lock "cinder-e9fbe649-8eaf-4982-86ba-c11402264531-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Lock "cinder-e9fbe649-8eaf-4982-86ba-c11402264531-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Acquiring lock "cinder-quobyte-6a16e757-3d1b-48a5-8675-ba9410b54c30" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Lock "cinder-quobyte-6a16e757-3d1b-48a5-8675-ba9410b54c30" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Acquiring lock "cinder-quobyte-e9fbe649-8eaf-4982-86ba-c11402264531" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Lock "cinder-quobyte-e9fbe649-8eaf-4982-86ba-c11402264531" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Deleting offline snapshot e9fbe649-8eaf-4982-86ba-c11402264531 of volume 6a16e757-3d1b-48a5-8675-ba9410b54c30 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] snapshot_file for this snap is: volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c2704f-b168-4fc3-862e-563b9b313076]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:47 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 Aug 26 12:08:47 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:47 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531" returned: 0 in 0.471s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a16e757-3d1b-48a5-8675-ba9410b54c30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5267622-7604-4a5a-a595-4df28128f99d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:47 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 Aug 26 12:08:47 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d38bd58-9518-4ad3-a618-b38380d4d23d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:48 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 Aug 26 12:08:48 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:48 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30" returned: 0 in 0.576s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:48 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 Aug 26 12:08:48 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:48 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32" returned: 0 in 0.651s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3891ac1-77a1-4ae3-9913-dec2a0756a75]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:48 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531" returned: 0 in 0.498s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:48 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 Aug 26 12:08:48 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:48 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531 Aug 26 12:08:48 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:49 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30.e9fbe649-8eaf-4982-86ba-c11402264531" returned: 0 in 0.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:49 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Lock "cinder-quobyte-e9fbe649-8eaf-4982-86ba-c11402264531" released by "_delete_snapshot" :: held 1.979s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32" returned: 0 in 0.470s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.3538dc2e-0ae5-4f9e-b058-f1a13be943f7q8w39bse.img {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Lock "cinder-quobyte-6a16e757-3d1b-48a5-8675-ba9410b54c30" released by "delete_snapshot" :: held 2.022s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:49 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.3538dc2e-0ae5-4f9e-b058-f1a13be943f7q8w39bse.img Aug 26 12:08:49 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:49 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Created reservations ['f43d2eca-c6e3-4756-988d-7be653971f04', '0977adc5-6c3d-4d52-8724-5f6cf7c8b132', '2043b6e7-87a1-464e-9743-e5863e10d07f', 'f84df51a-7c08-4501-9fe7-595b8e97793b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Delete snapshot completed successfully. Aug 26 12:08:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cd127166-47ae-4106-a3a1-0a8c18d5790d tempest-VolumesExtendTest-106882959 None] Lock "cinder-e9fbe649-8eaf-4982-86ba-c11402264531-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Acquiring lock "cinder-6a16e757-3d1b-48a5-8675-ba9410b54c30-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Lock "cinder-6a16e757-3d1b-48a5-8675-ba9410b54c30-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Acquiring lock "cinder-quobyte-6a16e757-3d1b-48a5-8675-ba9410b54c30" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:08:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Lock "cinder-quobyte-6a16e757-3d1b-48a5-8675-ba9410b54c30" acquired by "delete_volume" :: waited 0.036s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:08:51 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[196ba9ce-a390-4d6c-9635-981879a42cb0]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:51 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 Aug 26 12:08:51 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:52 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30" returned: 0 in 0.924s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:52 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30 Aug 26 12:08:52 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:52 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6a16e757-3d1b-48a5-8675-ba9410b54c30" returned: 0 in 0.420s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Lock "cinder-quobyte-6a16e757-3d1b-48a5-8675-ba9410b54c30" released by "delete_volume" :: held 1.527s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Created reservations ['b4e8f568-affa-451c-aef2-aed4f01e58a3', '48d1bc9d-a3ff-4bf9-bc54-1fb9509abb83', '6229c9ee-aa80-4fad-82a4-8f5b70c18264', '38ff6c80-8e73-4d39-8c06-e74b1872b2aa'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:08:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:53 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:08:53 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:53 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.586s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:53 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:08:53 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Deleted volume successfully. Aug 26 12:08:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02897c2b-5d9d-48de-b761-07e6a9af11cc tempest-VolumesExtendTest-106882959 None] Lock "cinder-6a16e757-3d1b-48a5-8675-ba9410b54c30-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:08:55 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.3538dc2e-0ae5-4f9e-b058-f1a13be943f7q8w39bse.img" returned: 0 in 6.219s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:55 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad49166a-9ddd-4f65-88ed-209759be4981]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:08:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:08:55 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 Aug 26 12:08:55 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:08:56 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Aug 26 12:08:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32" returned: 0 in 0.610s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:08:56 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.3538dc2e-0ae5-4f9e-b058-f1a13be943f7q8w39bse.img {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:08:56 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Converted 1024.00 MB image at 164.62 MB/s Aug 26 12:08:56 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] 3538dc2e-0ae5-4f9e-b058-f1a13be943f7 was raw, no need to convert to raw {{(pid=94387) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 12:09:06 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=130,cinder:DELETE=9,cinder:SELECT=116,cinder:INSERT=43 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:09:06 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=118,cinder:UPDATE=151,cinder:INSERT=47,cinder:DELETE=14 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (e2ad187e-97dc-4755-90bf-ea08cbbb5a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b81811-6aeb-42e8-ab4d-74fcb35a74ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b81811-6aeb-42e8-ab4d-74fcb35a74ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-883118682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2284f500-df70-4bda-941c-1d59a1f3f2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e4401392474b8cbec19aaf7cb21093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:09Z,use_quota=True,user_id='5834cf6496324cce81c73bf8a025683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccefeba3-1683-40c0-bf61-16ef5960c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccefeba3-1683-40c0-bf61-16ef5960c286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed5840f-9fbb-449d-803c-af7b03cbc5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed5840f-9fbb-449d-803c-af7b03cbc5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2284f500-df70-4bda-941c-1d59a1f3f2a5', 'volume_name': 'volume-2284f500-df70-4bda-941c-1d59a1f3f2a5', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67fcfee-260e-4ff4-b8cd-21c0900679b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67fcfee-260e-4ff4-b8cd-21c0900679b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce3ee51-2c05-487e-9cec-e0b544b83b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:09 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Volume 2284f500-df70-4bda-941c-1d59a1f3f2a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2284f500-df70-4bda-941c-1d59a1f3f2a5', 'volume_size': 1} Aug 26 12:09:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:09:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:10 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:09:10 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:10 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.412s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Flow 'volume_create_manager' (cb114018-f0f3-46e8-bf7a-9b734dede419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70a6bda-df27-4fdd-9d94-a8e197b14588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70a6bda-df27-4fdd-9d94-a8e197b14588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-782747167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e04e76-07ad-4e42-97eb-74be33526634,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0511208e0eaa4c82b24e137bd04498d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:11Z,use_quota=True,user_id='c8eca3564a6f4954a91ffe326db3f025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffb44f0-1317-45be-b790-cbeae20777a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffb44f0-1317-45be-b790-cbeae20777a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366b0088-6305-47a2-9ff4-3113cf506768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366b0088-6305-47a2-9ff4-3113cf506768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e04e76-07ad-4e42-97eb-74be33526634', 'volume_name': 'volume-99e04e76-07ad-4e42-97eb-74be33526634', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6034c29c-42ff-4de1-8d3c-374b7d9f622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6034c29c-42ff-4de1-8d3c-374b7d9f622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10cc123-8c99-47c7-b7db-2ea8d14d031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:11 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Volume 99e04e76-07ad-4e42-97eb-74be33526634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e04e76-07ad-4e42-97eb-74be33526634', 'volume_size': 1} Aug 26 12:09:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Flow 'volume_create_manager' (64b50ab3-dd9f-4b27-9d36-5063f1999cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c98a1f4-19ad-45aa-a0f5-49913a8d58e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c98a1f4-19ad-45aa-a0f5-49913a8d58e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129676036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f153e7bf-a909-4d00-87ce-6c9f07dd272c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81754d3acded457194f10c6495b3400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:17Z,use_quota=True,user_id='055e4ce12dc145b0af4bc57afdf7ac96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f423e3f6-d52c-486c-8f6c-e5449506d3ea),volume_type_id=f423e3f6-d52c-486c-8f6c-e5449506d3ea)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10ef944-e4fd-4a42-8a02-ea5867b1f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10ef944-e4fd-4a42-8a02-ea5867b1f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5158566d-53f1-4c86-9fdc-8d78b14a7886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5158566d-53f1-4c86-9fdc-8d78b14a7886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f153e7bf-a909-4d00-87ce-6c9f07dd272c', 'volume_name': 'volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf58c166-bde4-495c-baed-b9743fb3ec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf58c166-bde4-495c-baed-b9743fb3ec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae74e94-0abc-4fc3-8a55-d525f4af0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Volume f153e7bf-a909-4d00-87ce-6c9f07dd272c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c', 'volume_size': 1} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Flow 'volume_create_manager' (3ddd64a9-c5f2-44c4-86f3-c5b1f5a2695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a1878a-5d08-4fcd-ab48-e5a66f89e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a1878a-5d08-4fcd-ab48-e5a66f89e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1443576710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584fcdae-3e5c-49f4-928a-88d7195e5c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81754d3acded457194f10c6495b3400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:18Z,use_quota=True,user_id='055e4ce12dc145b0af4bc57afdf7ac96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(027773f3-ef85-4cac-9bd9-6ea44098bff5),volume_type_id=027773f3-ef85-4cac-9bd9-6ea44098bff5)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3f2ca-ae17-416b-bf77-14361d8982a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3f2ca-ae17-416b-bf77-14361d8982a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268ed9fa-475a-4fc8-a5a8-eb94da46d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268ed9fa-475a-4fc8-a5a8-eb94da46d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '584fcdae-3e5c-49f4-928a-88d7195e5c5b', 'volume_name': 'volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4b9f83-367a-4172-b239-6cada397a998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4b9f83-367a-4172-b239-6cada397a998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5918358a-1d48-45fe-bc4a-75f35f400503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Volume 584fcdae-3e5c-49f4-928a-88d7195e5c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b', 'volume_size': 1} Aug 26 12:09:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Flow 'volume_create_manager' (7ad42bd8-47a3-4d9d-a75b-403c96ab2264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc089e57-0f52-4260-b683-10315aa1122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc089e57-0f52-4260-b683-10315aa1122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-246396972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d3c3f0-db13-4969-8e62-0a1a5f43381c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81754d3acded457194f10c6495b3400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:18Z,use_quota=True,user_id='055e4ce12dc145b0af4bc57afdf7ac96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8aeba4f4-20c7-4f66-84fe-26fcc6e93d14),volume_type_id=8aeba4f4-20c7-4f66-84fe-26fcc6e93d14)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d05c54-1317-401f-bc81-4d1310fb0dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d05c54-1317-401f-bc81-4d1310fb0dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b110035d-b0d1-48ff-bf8d-351d3ebd2508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b110035d-b0d1-48ff-bf8d-351d3ebd2508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89d3c3f0-db13-4969-8e62-0a1a5f43381c', 'volume_name': 'volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c', 'volume_size': 1, 'image_id': '225f8edf-d784-406a-8833-41cd732d76d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/225f8edf-d784-406a-8833-41cd732d76d9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1698018215', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81754d3acded457194f10c6495b3400d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '225f8edf-d784-406a-8833-41cd732d76d9', 'created_at': datetime.datetime(2026, 8, 26, 10, 9, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 9, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/225f8edf-d784-406a-8833-41cd732d76d9/file', 'properties': {}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c69a2a-920e-4139-af44-b305347cad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c69a2a-920e-4139-af44-b305347cad46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2987b10e-0438-473d-8f79-6aa3de676cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:18 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Volume 89d3c3f0-db13-4969-8e62-0a1a5f43381c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c', 'volume_size': 1, 'image_id': '225f8edf-d784-406a-8833-41cd732d76d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/225f8edf-d784-406a-8833-41cd732d76d9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1698018215', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81754d3acded457194f10c6495b3400d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '225f8edf-d784-406a-8833-41cd732d76d9', 'created_at': datetime.datetime(2026, 8, 26, 10, 9, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 9, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/225f8edf-d784-406a-8833-41cd732d76d9/file', 'properties': {}}, 'image_service': } Aug 26 12:09:18 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Trying to clone 89d3c3f0-db13-4969-8e62-0a1a5f43381c from image 225f8edf-d784-406a-8833-41cd732d76d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/225f8edf-d784-406a-8833-41cd732d76d9', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.932s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Uploaded volume to glance image-id: 3538dc2e-0ae5-4f9e-b058-f1a13be943f7. {{(pid=94387) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.781s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-883118682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2284f500-df70-4bda-941c-1d59a1f3f2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e4401392474b8cbec19aaf7cb21093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:09Z,use_quota=True,user_id='5834cf6496324cce81c73bf8a025683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Creating volume 2284f500-df70-4bda-941c-1d59a1f3f2a5 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:20 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:09:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:21 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 1073741824 Aug 26 12:09:21 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2de3f8df-5447-431a-90b2-b3e663e9c312 tempest-VolumesActionsTest-1503789506 None] Copy volume to image completed successfully. Aug 26 12:09:21 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 1073741824" returned: 0 in 0.455s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:21 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 Aug 26 12:09:21 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:21 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5" returned: 0 in 0.260s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.584s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-782747167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e04e76-07ad-4e42-97eb-74be33526634,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0511208e0eaa4c82b24e137bd04498d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:11Z,use_quota=True,user_id='c8eca3564a6f4954a91ffe326db3f025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Creating volume 99e04e76-07ad-4e42-97eb-74be33526634 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:21 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:21 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634 1073741824 Aug 26 12:09:21 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce3ee51-2c05-487e-9cec-e0b544b83b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2284f500-df70-4bda-941c-1d59a1f3f2a5', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c40ed8-6dca-44c6-b8dd-51ae05193a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:21 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Volume volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 (2284f500-df70-4bda-941c-1d59a1f3f2a5): created successfully Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c40ed8-6dca-44c6-b8dd-51ae05193a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (e2ad187e-97dc-4755-90bf-ea08cbbb5a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fe28c9ff-b90e-413f-8821-e0bb007eb49f tempest-VolumesSnapshotTestJSON-479568879 None] Created volume successfully. Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:22 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634 1073741824" returned: 0 in 0.555s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:22 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634 Aug 26 12:09:22 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:22 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.083s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129676036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f153e7bf-a909-4d00-87ce-6c9f07dd272c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81754d3acded457194f10c6495b3400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:17Z,use_quota=True,user_id='055e4ce12dc145b0af4bc57afdf7ac96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f423e3f6-d52c-486c-8f6c-e5449506d3ea),volume_type_id=f423e3f6-d52c-486c-8f6c-e5449506d3ea)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Creating volume f153e7bf-a909-4d00-87ce-6c9f07dd272c {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:22 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:22 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c 1073741824 Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10cc123-8c99-47c7-b7db-2ea8d14d031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e04e76-07ad-4e42-97eb-74be33526634', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:22 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a2c97-46ef-4e36-8240-a831f049a52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:22 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Volume volume-99e04e76-07ad-4e42-97eb-74be33526634 (99e04e76-07ad-4e42-97eb-74be33526634): created successfully Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a2c97-46ef-4e36-8240-a831f049a52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Flow 'volume_create_manager' (cb114018-f0f3-46e8-bf7a-9b734dede419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:22 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1fd93598-a825-4d43-9c71-302c0f66d9fc tempest-VolumesListTestJSON-1566459804 None] Created volume successfully. Aug 26 12:09:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:23 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c 1073741824" returned: 0 in 0.482s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:23 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c Aug 26 12:09:23 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD, size 20.69 MB, duration 4.31 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:09:23 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Image download 20.69 MB at 4.80 MB/s Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2963b8-4eb9-491d-a67a-d83d575c189c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:23 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD Aug 26 12:09:23 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:23 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c" returned: 0 in 0.257s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.534s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1443576710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584fcdae-3e5c-49f4-928a-88d7195e5c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81754d3acded457194f10c6495b3400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:18Z,use_quota=True,user_id='055e4ce12dc145b0af4bc57afdf7ac96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(027773f3-ef85-4cac-9bd9-6ea44098bff5),volume_type_id=027773f3-ef85-4cac-9bd9-6ea44098bff5)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Creating volume 584fcdae-3e5c-49f4-928a-88d7195e5c5b {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:23 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae74e94-0abc-4fc3-8a55-d525f4af0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:23 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b 1073741824 Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcd21a1-0dd5-461a-9b09-b8eca287ef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:23 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:23 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Volume volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c (f153e7bf-a909-4d00-87ce-6c9f07dd272c): created successfully Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcd21a1-0dd5-461a-9b09-b8eca287ef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Flow 'volume_create_manager' (64b50ab3-dd9f-4b27-9d36-5063f1999cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8f23d6fa-8f59-48a1-ac00-2f11a0a0b9d9 tempest-TestInstancesWithCinderVolumes-295371566 None] Created volume successfully. Aug 26 12:09:23 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Temporary image 225f8edf-d784-406a-8833-41cd732d76d9 is fetched for user 055e4ce12dc145b0af4bc57afdf7ac96. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c766b84-fc41-4ee1-8f00-cea67032034c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:23 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD Aug 26 12:09:23 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:23 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b 1073741824" returned: 0 in 0.506s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:24 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b Aug 26 12:09:24 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:24 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:24 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b" returned: 0 in 0.265s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.987s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5918358a-1d48-45fe-bc4a-75f35f400503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf69a50-1c94-4e27-9652-b4ab93e6eb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Creating offline snapshot 97e31ed2-7e7c-4665-89e7-6ec7f16a3404 of volume 2284f500-df70-4bda-941c-1d59a1f3f2a5 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:09:24 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Volume volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b (584fcdae-3e5c-49f4-928a-88d7195e5c5b): created successfully Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf69a50-1c94-4e27-9652-b4ab93e6eb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Flow 'volume_create_manager' (3ddd64a9-c5f2-44c4-86f3-c5b1f5a2695e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce91186a-2817-4a3b-8acb-00189fccb1f6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:24 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-55fe5b54-a120-4f13-b91a-5ca8e1cd85bb tempest-TestInstancesWithCinderVolumes-295371566 None] Created volume successfully. Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Flow 'volume_create_manager' (d37966d0-191c-4d34-beae-5e0d3b320ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbf1ba7-bfcb-40c0-b108-cd3d98fd72f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbf1ba7-bfcb-40c0-b108-cd3d98fd72f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-931795204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed810d69-e652-415f-8f09-e420a41da6f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0511208e0eaa4c82b24e137bd04498d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:24Z,use_quota=True,user_id='c8eca3564a6f4954a91ffe326db3f025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:24 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 Aug 26 12:09:24 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f21e8c4-f990-47b9-b482-29a2be44f1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f21e8c4-f990-47b9-b482-29a2be44f1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94616a42-f5d4-4373-9512-8d3b7e91f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94616a42-f5d4-4373-9512-8d3b7e91f15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed810d69-e652-415f-8f09-e420a41da6f1', 'volume_name': 'volume-ed810d69-e652-415f-8f09-e420a41da6f1', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c76781-29ac-4556-9934-6685991e5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c76781-29ac-4556-9934-6685991e5097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d2d22f-eb6e-4d02-b684-bc601ce84d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:24 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Volume ed810d69-e652-415f-8f09-e420a41da6f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed810d69-e652-415f-8f09-e420a41da6f1', 'volume_size': 1} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:24 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5" returned: 0 in 0.368s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:24 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 1G Aug 26 12:09:24 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:25 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 1G" returned: 0 in 0.381s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:25 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 Aug 26 12:09:25 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:25 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404" returned: 0 in 0.300s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:25 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 is being set with open permissions: ugo+rw Aug 26 12:09:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:25 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 Aug 26 12:09:25 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:25 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404" returned: 0 in 0.236s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:25 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.info Aug 26 12:09:25 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:25 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.info" returned: 0 in 0.266s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:25 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.info is being set with open permissions: ugo+rw Aug 26 12:09:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:25 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.info Aug 26 12:09:25 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:26 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.info" returned: 0 in 0.245s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.274s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[30179ca1-ba39-4f18-8ca3-eec6ccef6934]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:26 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-27d1d1c1-4ca3-4488-97de-643090145014 tempest-VolumesSnapshotTestJSON-479568879 None] Create snapshot completed successfully Aug 26 12:09:26 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 Aug 26 12:09:26 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:26 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-97e31ed2-7e7c-4665-89e7-6ec7f16a3404-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32" returned: 0 in 0.385s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-97e31ed2-7e7c-4665-89e7-6ec7f16a3404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2b0a8c-1732-45b7-a5bb-0ed0356fefc8]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-2284f500-df70-4bda-941c-1d59a1f3f2a5" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-2284f500-df70-4bda-941c-1d59a1f3f2a5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-97e31ed2-7e7c-4665-89e7-6ec7f16a3404" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-97e31ed2-7e7c-4665-89e7-6ec7f16a3404" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Deleting offline snapshot 97e31ed2-7e7c-4665-89e7-6ec7f16a3404 of volume 2284f500-df70-4bda-941c-1d59a1f3f2a5 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] snapshot_file for this snap is: volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b57dea-612e-4134-aedf-5f63d1f40235]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:26 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 Aug 26 12:09:26 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:26 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 Aug 26 12:09:26 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:26 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32" returned: 0 in 0.364s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:27 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img Aug 26 12:09:27 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:27 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404" returned: 0 in 0.375s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2284f500-df70-4bda-941c-1d59a1f3f2a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:09:27 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a27534c-4f3f-41c6-955b-454b74daf38c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:27 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 Aug 26 12:09:27 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:27 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5" returned: 0 in 0.559s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:27 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 Aug 26 12:09:27 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:28 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404" returned: 0 in 0.990s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:28 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404 Aug 26 12:09:28 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:29 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5.97e31ed2-7e7c-4665-89e7-6ec7f16a3404" returned: 0 in 0.896s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-97e31ed2-7e7c-4665-89e7-6ec7f16a3404" released by "_delete_snapshot" :: held 2.976s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-2284f500-df70-4bda-941c-1d59a1f3f2a5" released by "delete_snapshot" :: held 3.010s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:29 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Created reservations ['c04fd081-24fc-49ea-9fea-f5502df3fb41', '39c929d0-bc95-4901-b5c0-8f2a96a2e8c6', 'e96d8fdc-b430-49cf-b26d-1df8286e902b', '2ce660ea-72b7-4d58-ac4b-bf8cff9b0e85'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:09:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Delete snapshot completed successfully. Aug 26 12:09:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2313a556-55d9-4bf1-bd35-428ae3a382dd tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-97e31ed2-7e7c-4665-89e7-6ec7f16a3404-delete_snapshot" released by "delete_snapshot" :: held 3.455s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:31 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img" returned: 0 in 4.322s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[848f6fe9-b298-4add-85e8-d5dd0ee23713]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:31 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 Aug 26 12:09:31 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (3d739b7d-1bc2-4939-b533-a2ca62a8bad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508cba9e-450b-47bb-aaf2-f9d890ac94b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508cba9e-450b-47bb-aaf2-f9d890ac94b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1111154362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82550d68-2e7a-4dce-9348-8cf168234be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e4401392474b8cbec19aaf7cb21093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:32Z,use_quota=True,user_id='5834cf6496324cce81c73bf8a025683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7877804-4d5f-4edd-af5d-8497c043ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7877804-4d5f-4edd-af5d-8497c043ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae47ae0a-bf72-420b-8b92-4131ee4fed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae47ae0a-bf72-420b-8b92-4131ee4fed65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82550d68-2e7a-4dce-9348-8cf168234be6', 'volume_name': 'volume-82550d68-2e7a-4dce-9348-8cf168234be6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a948b34f-961d-4ed0-a1ca-bb3a318c150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a948b34f-961d-4ed0-a1ca-bb3a318c150b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8405fab7-cae3-42c3-8d97-a6a6e2a4e239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:31 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Volume 82550d68-2e7a-4dce-9348-8cf168234be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82550d68-2e7a-4dce-9348-8cf168234be6', 'volume_size': 1} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:31 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32" returned: 0 in 0.561s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:09:31 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Converted 1024.00 MB image at 236.72 MB/s Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] 44bfe780-958f-45e7-8727-f0acfafeaefd was raw, converting to qcow2 {{(pid=94387) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6216e72-0106-4a5d-b21a-7520425fef6b]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:32 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img Aug 26 12:09:32 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:32 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img" returned: 0 in 0.315s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:32 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img Aug 26 12:09:32 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:32 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img" returned: 1 in 0.324s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:09:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img /opt/stack/data/cinder/conversion/vol_upload_okhp0wgn {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:32 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img /opt/stack/data/cinder/conversion/vol_upload_okhp0wgn Aug 26 12:09:32 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:32 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img /opt/stack/data/cinder/conversion/vol_upload_okhp0wgn" returned: 0 in 0.263s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:32 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Image conversion details: src /opt/stack/data/cinder/conversion/175af301-ba1b-4ea9-877c-77b76dc4da32.temp_image.44bfe780-958f-45e7-8727-f0acfafeaefdo3rbnwc5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_okhp0wgn {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:09:32 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 26 12:09:32 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[99adacea-b46c-4cde-a88d-97b53ee98607]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_okhp0wgn {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:32 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_okhp0wgn Aug 26 12:09:32 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:33 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_okhp0wgn" returned: 0 in 0.316s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.160s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Uploaded volume to glance image-id: 44bfe780-958f-45e7-8727-f0acfafeaefd. {{(pid=94387) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.250s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-246396972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d3c3f0-db13-4969-8e62-0a1a5f43381c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81754d3acded457194f10c6495b3400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:18Z,use_quota=True,user_id='055e4ce12dc145b0af4bc57afdf7ac96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8aeba4f4-20c7-4f66-84fe-26fcc6e93d14),volume_type_id=8aeba4f4-20c7-4f66-84fe-26fcc6e93d14)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Creating volume 89d3c3f0-db13-4969-8e62-0a1a5f43381c {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:34 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:34 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c 1073741824 Aug 26 12:09:34 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-244bae51-07a5-43ff-9644-14a6110cfbef tempest-VolumesActionsTest-1503789506 None] Copy volume to image completed successfully. Aug 26 12:09:34 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c 1073741824" returned: 0 in 0.442s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:34 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c Aug 26 12:09:34 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:35 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Acquiring lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c" returned: 0 in 0.278s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.659s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-931795204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed810d69-e652-415f-8f09-e420a41da6f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0511208e0eaa4c82b24e137bd04498d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:24Z,use_quota=True,user_id='c8eca3564a6f4954a91ffe326db3f025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Creating volume ed810d69-e652-415f-8f09-e420a41da6f1 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:35 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:35 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1 1073741824 Aug 26 12:09:35 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Attempting download of 225f8edf-d784-406a-8833-41cd732d76d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/225f8edf-d784-406a-8833-41cd732d76d9', 'metadata': {}}])) to volume 89d3c3f0-db13-4969-8e62-0a1a5f43381c. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Acquiring lock "cinder-quobyte-175af301-ba1b-4ea9-877c-77b76dc4da32" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Lock "cinder-quobyte-175af301-ba1b-4ea9-877c-77b76dc4da32" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2651c2-b621-4067-bda6-2666c9e66d67]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a94d7e-74ec-4642-9be5-ffcb7002ccd4]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_225f8edf-d784-406a-8833-41cd732d76d9_1548j5x1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:35 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 Aug 26 12:09:35 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:35 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_225f8edf-d784-406a-8833-41cd732d76d9_1548j5x1 Aug 26 12:09:35 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:35 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1 1073741824" returned: 0 in 0.461s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:35 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_225f8edf-d784-406a-8833-41cd732d76d9_1548j5x1" returned: 0 in 0.336s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_225f8edf-d784-406a-8833-41cd732d76d9_1548j5x1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:35 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32" returned: 0 in 0.410s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:35 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1 Aug 26 12:09:35 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:35 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32 Aug 26 12:09:35 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:35 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_225f8edf-d784-406a-8833-41cd732d76d9_1548j5x1 Aug 26 12:09:35 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:35 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1" returned: 0 in 0.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.217s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1111154362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82550d68-2e7a-4dce-9348-8cf168234be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e4401392474b8cbec19aaf7cb21093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:32Z,use_quota=True,user_id='5834cf6496324cce81c73bf8a025683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Creating volume 82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:35 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:35 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:09:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:35 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_225f8edf-d784-406a-8833-41cd732d76d9_1548j5x1" returned: 1 in 0.345s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_225f8edf-d784-406a-8833-41cd732d76d9_1548j5x1' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-175af301-ba1b-4ea9-877c-77b76dc4da32" returned: 0 in 0.292s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af68f2f-31b3-4d04-becf-8e49296b828e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:36 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 1073741824 Aug 26 12:09:36 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d2d22f-eb6e-4d02-b684-bc601ce84d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed810d69-e652-415f-8f09-e420a41da6f1', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be808ebb-171e-4fee-9965-53281a9e1859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Lock "cinder-quobyte-175af301-ba1b-4ea9-877c-77b76dc4da32" released by "delete_volume" :: held 0.774s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Volume volume-ed810d69-e652-415f-8f09-e420a41da6f1 (ed810d69-e652-415f-8f09-e420a41da6f1): created successfully Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be808ebb-171e-4fee-9965-53281a9e1859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Flow 'volume_create_manager' (d37966d0-191c-4d34-beae-5e0d3b320ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d40a7a07-a1e4-4a4c-bcf2-2f0b6a11f102 tempest-VolumesListTestJSON-1566459804 None] Created volume successfully. Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Created reservations ['f6081fab-4756-4f65-a6c2-6b2deff75e2a', '70969b13-fddd-42b3-b74f-f831665ca9d2', '46af9e9d-fc24-454d-b242-31104dc43f86', '6f073f0e-7bc4-46be-b7ba-da91751bb03d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:09:36 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD Aug 26 12:09:36 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:36 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:09:36 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:36 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] 225f8edf-d784-406a-8833-41cd732d76d9 was qcow2, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:36 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c Aug 26 12:09:36 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:36 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.335s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:09:36 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 1073741824" returned: 0 in 0.564s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Deleted volume successfully. Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1aef45ac-fc04-4c78-9d0c-d5c07b16bf76 tempest-VolumesActionsTest-1503789506 None] Lock "cinder-175af301-ba1b-4ea9-877c-77b76dc4da32-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:36 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 Aug 26 12:09:36 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:37 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6" returned: 0 in 0.422s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8405fab7-cae3-42c3-8d97-a6a6e2a4e239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82550d68-2e7a-4dce-9348-8cf168234be6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab6fdd1-fad3-43e6-8ec7-6f073f683228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:37 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Volume volume-82550d68-2e7a-4dce-9348-8cf168234be6 (82550d68-2e7a-4dce-9348-8cf168234be6): created successfully Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab6fdd1-fad3-43e6-8ec7-6f073f683228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (3d739b7d-1bc2-4939-b533-a2ca62a8bad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:37 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ae74ca7f-49be-4e65-b071-8ce5112b1f2e tempest-VolumesSnapshotTestJSON-479568879 None] Created volume successfully. Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Flow 'volume_create_manager' (c5bf0f55-1f03-43be-b3c1-d35234492e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f1ea0d-d556-4578-bad0-159306152dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f1ea0d-d556-4578-bad0-159306152dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1920572414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d605b7d1-4b26-4534-a0b6-95949f6c1123,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0511208e0eaa4c82b24e137bd04498d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:37Z,use_quota=True,user_id='c8eca3564a6f4954a91ffe326db3f025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0461f1c-a236-45b2-80df-7063be1113f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0461f1c-a236-45b2-80df-7063be1113f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58cea89-5063-425b-8367-9c3370a9bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58cea89-5063-425b-8367-9c3370a9bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd605b7d1-4b26-4534-a0b6-95949f6c1123', 'volume_name': 'volume-d605b7d1-4b26-4534-a0b6-95949f6c1123', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0171cf8c-f45b-4b6c-a95e-0e10f0a2bd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0171cf8c-f45b-4b6c-a95e-0e10f0a2bd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ef344d-1fe1-446e-99b1-1c4db01885fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:37 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Volume d605b7d1-4b26-4534-a0b6-95949f6c1123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d605b7d1-4b26-4534-a0b6-95949f6c1123', 'volume_size': 1} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1920572414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d605b7d1-4b26-4534-a0b6-95949f6c1123,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0511208e0eaa4c82b24e137bd04498d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:37Z,use_quota=True,user_id='c8eca3564a6f4954a91ffe326db3f025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Creating volume d605b7d1-4b26-4534-a0b6-95949f6c1123 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:37 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:37 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 1073741824 Aug 26 12:09:37 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:37 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 1073741824" returned: 0 in 0.543s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:37 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 Aug 26 12:09:37 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:38 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123" returned: 0 in 0.304s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ef344d-1fe1-446e-99b1-1c4db01885fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d605b7d1-4b26-4534-a0b6-95949f6c1123', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bd08b2-44f0-4ec4-baba-8824b0d27f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:38 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Volume volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 (d605b7d1-4b26-4534-a0b6-95949f6c1123): created successfully Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bd08b2-44f0-4ec4-baba-8824b0d27f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Flow 'volume_create_manager' (c5bf0f55-1f03-43be-b3c1-d35234492e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:38 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f047def8-9b0c-4c2f-942d-693f7bfe32ec tempest-VolumesListTestJSON-1566459804 None] Created volume successfully. Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Creating offline snapshot bbb7debb-cade-4d63-a39e-ec113c86e835 of volume 82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a02cf3-ad86-47e4-b1b7-493671728761]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:38 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 Aug 26 12:09:38 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:38 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c" returned: 0 in 2.206s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_225f8edf-d784-406a-8833-41cd732d76d9_3ovw5fjddevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:09:38 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Converted 112.00 MB image at 50.75 MB/s Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:38 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c 1G Aug 26 12:09:38 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:38 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6" returned: 0 in 0.403s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:38 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 1G Aug 26 12:09:38 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:38 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c 1G" returned: 0 in 0.360s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:38 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Downloaded image 225f8edf-d784-406a-8833-41cd732d76d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/225f8edf-d784-406a-8833-41cd732d76d9', 'metadata': {}}])) to volume 89d3c3f0-db13-4969-8e62-0a1a5f43381c successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Temporary image 225f8edf-d784-406a-8833-41cd732d76d9 for user 055e4ce12dc145b0af4bc57afdf7ac96 is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Marking volume 89d3c3f0-db13-4969-8e62-0a1a5f43381c as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Copying metadata from image 225f8edf-d784-406a-8833-41cd732d76d9 to 89d3c3f0-db13-4969-8e62-0a1a5f43381c. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Creating volume glance metadata for volume 89d3c3f0-db13-4969-8e62-0a1a5f43381c backed by image 225f8edf-d784-406a-8833-41cd732d76d9 with: {'image_id': '225f8edf-d784-406a-8833-41cd732d76d9', 'image_name': 'tempest-scenario-img--1698018215', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2987b10e-0438-473d-8f79-6aa3de676cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c', 'volume_size': 1, 'image_id': '225f8edf-d784-406a-8833-41cd732d76d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/225f8edf-d784-406a-8833-41cd732d76d9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1698018215', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81754d3acded457194f10c6495b3400d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '225f8edf-d784-406a-8833-41cd732d76d9', 'created_at': datetime.datetime(2026, 8, 26, 10, 9, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 9, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/225f8edf-d784-406a-8833-41cd732d76d9/file', 'properties': {}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49a4b59-5d77-46c9-b9c4-40146089f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:39 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Volume volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c (89d3c3f0-db13-4969-8e62-0a1a5f43381c): created successfully Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49a4b59-5d77-46c9-b9c4-40146089f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Flow 'volume_create_manager' (7ad42bd8-47a3-4d9d-a75b-403c96ab2264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-00e45641-4224-4bab-800a-ed5821da5864 tempest-TestInstancesWithCinderVolumes-295371566 None] Created volume successfully. Aug 26 12:09:39 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 1G" returned: 0 in 0.516s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82550d68-2e7a-4dce-9348-8cf168234be6 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:39 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82550d68-2e7a-4dce-9348-8cf168234be6 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 Aug 26 12:09:39 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:39 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82550d68-2e7a-4dce-9348-8cf168234be6 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835" returned: 0 in 0.305s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:39 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 is being set with open permissions: ugo+rw Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:39 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 Aug 26 12:09:39 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:39 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835" returned: 0 in 0.249s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:39 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.info Aug 26 12:09:39 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:40 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.info" returned: 0 in 0.285s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:40 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.info is being set with open permissions: ugo+rw Aug 26 12:09:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:40 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.info Aug 26 12:09:40 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:40 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.info" returned: 0 in 0.351s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-28ebcbfa-92b4-45c1-96e8-7691f529a377 tempest-VolumesSnapshotTestJSON-479568879 None] Create snapshot completed successfully Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "cinder-d605b7d1-4b26-4534-a0b6-95949f6c1123-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-d605b7d1-4b26-4534-a0b6-95949f6c1123-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "cinder-quobyte-d605b7d1-4b26-4534-a0b6-95949f6c1123" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (3700837a-7263-4159-9771-1c3c11794f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ed34c3-9b8e-4ade-a5f4-8e6605f35f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-quobyte-d605b7d1-4b26-4534-a0b6-95949f6c1123" acquired by "delete_volume" :: waited 0.056s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ed34c3-9b8e-4ade-a5f4-8e6605f35f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-300766860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be62e5e-d734-4c0b-b931-2982520a1f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e4401392474b8cbec19aaf7cb21093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bbb7debb-cade-4d63-a39e-ec113c86e835,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:42Z,use_quota=True,user_id='5834cf6496324cce81c73bf8a025683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982978e3-55c4-4917-9019-ac1fbb188e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982978e3-55c4-4917-9019-ac1fbb188e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656bf8c2-2d61-4c30-859a-bc22681a8845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656bf8c2-2d61-4c30-859a-bc22681a8845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7be62e5e-d734-4c0b-b931-2982520a1f0e', 'volume_name': 'volume-7be62e5e-d734-4c0b-b931-2982520a1f0e', 'volume_size': 2, 'snapshot_id': 'bbb7debb-cade-4d63-a39e-ec113c86e835'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9763ab4-2dd8-41f2-83fa-f61ceae3c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9763ab4-2dd8-41f2-83fa-f61ceae3c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73fc9d3-c990-4875-85b5-837213af4fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:42 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Volume 7be62e5e-d734-4c0b-b931-2982520a1f0e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7be62e5e-d734-4c0b-b931-2982520a1f0e', 'volume_size': 2, 'snapshot_id': 'bbb7debb-cade-4d63-a39e-ec113c86e835'} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f006a080-dd36-4786-8a89-f682ebe57861]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-bbb7debb-cade-4d63-a39e-ec113c86e835-7be62e5e-d734-4c0b-b931-2982520a1f0e" by "_create_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-bbb7debb-cade-4d63-a39e-ec113c86e835-7be62e5e-d734-4c0b-b931-2982520a1f0e" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Creating volume 7be62e5e-d734-4c0b-b931-2982520a1f0e from snapshot bbb7debb-cade-4d63-a39e-ec113c86e835 {{(pid=94387) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-7be62e5e-d734-4c0b-b931-2982520a1f0e" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-7be62e5e-d734-4c0b-b931-2982520a1f0e" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] snapshot: bbb7debb-cade-4d63-a39e-ec113c86e835, volume: 7be62e5e-d734-4c0b-b931-2982520a1f0e, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2580487-f2f2-4f7a-9f9b-a210409625a6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:42 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 Aug 26 12:09:42 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:42 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 Aug 26 12:09:42 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:43 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123" returned: 0 in 0.543s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:43 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123 Aug 26 12:09:43 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:43 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835" returned: 0 in 0.454s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82550d68-2e7a-4dce-9348-8cf168234be6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[add23344-dfd5-475f-81d5-c892d0745b0d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:43 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 Aug 26 12:09:43 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:43 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d605b7d1-4b26-4534-a0b6-95949f6c1123" returned: 0 in 0.435s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-quobyte-d605b7d1-4b26-4534-a0b6-95949f6c1123" released by "delete_volume" :: held 1.081s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Created reservations ['72a93f58-4b04-4864-80a6-ed762dcee2c0', '7c54cff8-7740-482f-9572-184180366a63', '84ae722b-c42c-4352-8a93-c05df1571f5c', '2d5aa842-b6e4-48e8-a387-d4009c22ae14'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:09:43 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6" returned: 0 in 0.535s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:43 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e Aug 26 12:09:43 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:43 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:09:43 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:44 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.302s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:44 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:09:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Deleted volume successfully. Aug 26 12:09:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dc6419d5-bae0-41e6-8f4b-a24c23f218b4 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-d605b7d1-4b26-4534-a0b6-95949f6c1123-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-91aa78ba-ba61-4d26-87ba-0e050e22132f req-4b206266-0564-4fda-90e7-b12e932bee12 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "cinder-ed810d69-e652-415f-8f09-e420a41da6f1-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-ed810d69-e652-415f-8f09-e420a41da6f1-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "cinder-quobyte-ed810d69-e652-415f-8f09-e420a41da6f1" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-quobyte-ed810d69-e652-415f-8f09-e420a41da6f1" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:45 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6002d87-6d3b-48e7-8fc0-d77e978f16ac]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:45 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1 Aug 26 12:09:45 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:45 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1" returned: 0 in 0.499s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:45 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1 Aug 26 12:09:45 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:46 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed810d69-e652-415f-8f09-e420a41da6f1" returned: 0 in 0.378s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-quobyte-ed810d69-e652-415f-8f09-e420a41da6f1" released by "delete_volume" :: held 1.027s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:46 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Created reservations ['b7f36e0f-0c9f-4d63-bfa2-a8e69d412747', '0f1a49cc-dfa9-4993-82c4-0074160ce720', '6b0a7309-2f70-49d7-b1fe-8f3502afc84b', 'bf5950c7-035d-4473-8bc2-b177ed7ac24c'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:09:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:46 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:09:46 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:47 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.899s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:47 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:09:47 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Deleted volume successfully. Aug 26 12:09:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3501b2db-d6d7-4e90-9df8-754e681e1988 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-ed810d69-e652-415f-8f09-e420a41da6f1-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "cinder-99e04e76-07ad-4e42-97eb-74be33526634-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-99e04e76-07ad-4e42-97eb-74be33526634-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "cinder-quobyte-99e04e76-07ad-4e42-97eb-74be33526634" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-quobyte-99e04e76-07ad-4e42-97eb-74be33526634" acquired by "delete_volume" :: waited 0.035s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:48 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0fa7c-7642-44e5-9c5e-ed7359bcc332]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:48 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634 Aug 26 12:09:48 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:49 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634" returned: 0 in 0.725s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:49 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634 Aug 26 12:09:49 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:49 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-99e04e76-07ad-4e42-97eb-74be33526634" returned: 0 in 0.608s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-quobyte-99e04e76-07ad-4e42-97eb-74be33526634" released by "delete_volume" :: held 1.448s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:49 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Created reservations ['9894ecac-e1a4-4010-a328-38c20e015598', '13c8898e-0a72-4e10-ab8e-78fbd942bbba', '8a43608d-1824-4bf6-bf88-029a9206d341', '1edca664-7fb4-4c0b-80b7-c65fba4b5cd7'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:50 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:09:50 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:50 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e" returned: 0 in 6.715s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:09:50 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Converted 1024.00 MB image at 152.46 MB/s Aug 26 12:09:50 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e is being set with open permissions: ugo+rw Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:50 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e Aug 26 12:09:50 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:50 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.545s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:09:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Deleted volume successfully. Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-36a79046-1d85-4e7a-9a67-8d26a4282ec4 tempest-VolumesListTestJSON-1566459804 None] Lock "cinder-99e04e76-07ad-4e42-97eb-74be33526634-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:50 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e" returned: 0 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-7be62e5e-d734-4c0b-b931-2982520a1f0e" released by "_copy_volume_from_snapshot" :: held 8.169s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-bbb7debb-cade-4d63-a39e-ec113c86e835-7be62e5e-d734-4c0b-b931-2982520a1f0e" released by "_create_volume_from_snapshot" :: held 8.271s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.293s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-91aa78ba-ba61-4d26-87ba-0e050e22132f req-4b206266-0564-4fda-90e7-b12e932bee12 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.942s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73fc9d3-c990-4875-85b5-837213af4fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be62e5e-d734-4c0b-b931-2982520a1f0e', 'volume_size': 2, 'snapshot_id': 'bbb7debb-cade-4d63-a39e-ec113c86e835'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23881d24-ccc1-4869-ad4f-8606a9a0dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-91aa78ba-ba61-4d26-87ba-0e050e22132f req-4b206266-0564-4fda-90e7-b12e932bee12 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:51 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Volume volume-7be62e5e-d734-4c0b-b931-2982520a1f0e (7be62e5e-d734-4c0b-b931-2982520a1f0e): created successfully Aug 26 12:09:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23881d24-ccc1-4869-ad4f-8606a9a0dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (3700837a-7263-4159-9771-1c3c11794f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7325ffa1-f4fd-4655-8742-0ce267b6e70a tempest-VolumesSnapshotTestJSON-479568879 None] Created volume successfully. Aug 26 12:09:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-91aa78ba-ba61-4d26-87ba-0e050e22132f req-4b206266-0564-4fda-90e7-b12e932bee12 tempest-TestInstancesWithCinderVolumes-295371566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d125d31-adfd-4cd3-a56b-222450d8e8b3', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:09:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-91aa78ba-ba61-4d26-87ba-0e050e22132f req-4b206266-0564-4fda-90e7-b12e932bee12 tempest-TestInstancesWithCinderVolumes-295371566 None] attachment_update completed successfully. Aug 26 12:09:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-7be62e5e-d734-4c0b-b931-2982520a1f0e-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-7be62e5e-d734-4c0b-b931-2982520a1f0e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-7be62e5e-d734-4c0b-b931-2982520a1f0e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-7be62e5e-d734-4c0b-b931-2982520a1f0e" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:51 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d92cb-68d4-4379-a4f3-8fe15879db43]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:51 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e Aug 26 12:09:51 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:52 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e" returned: 0 in 0.388s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:52 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e Aug 26 12:09:52 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:52 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7be62e5e-d734-4c0b-b931-2982520a1f0e" returned: 0 in 0.317s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-7be62e5e-d734-4c0b-b931-2982520a1f0e" released by "delete_volume" :: held 0.755s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Created reservations ['c18e0dc5-40eb-4f46-8c80-618572f017ed', 'b21f6a94-d261-4723-884e-b08ed5bac3eb', 'e7f71ec1-27eb-47cd-94ba-20a32c913339', '72fe63dd-7633-46bc-876a-4de6a5c0a735'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:52 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:09:52 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-bbb7debb-cade-4d63-a39e-ec113c86e835-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-bbb7debb-cade-4d63-a39e-ec113c86e835-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-82550d68-2e7a-4dce-9348-8cf168234be6" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:53 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.500s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-82550d68-2e7a-4dce-9348-8cf168234be6" acquired by "delete_snapshot" :: waited 0.073s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-bbb7debb-cade-4d63-a39e-ec113c86e835" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:53 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Deleted volume successfully. Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-bbb7debb-cade-4d63-a39e-ec113c86e835" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Deleting offline snapshot bbb7debb-cade-4d63-a39e-ec113c86e835 of volume 82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] snapshot_file for this snap is: volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-acb432a5-f12f-4a33-8724-3eed5e132893 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-7be62e5e-d734-4c0b-b931-2982520a1f0e-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4a81f2-55ef-4de4-aa59-70fa3f6f891b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:53 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 Aug 26 12:09:53 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:54 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835" returned: 0 in 0.871s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82550d68-2e7a-4dce-9348-8cf168234be6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:09:54 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b5aa3-fbac-411f-977f-ac3ae5899c07]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:54 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 Aug 26 12:09:54 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:55 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6" returned: 0 in 0.962s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:55 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 Aug 26 12:09:55 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Flow 'volume_create_manager' (e2739c08-237c-4b76-88ed-bc4302245051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d766e250-2d86-4e68-abc1-ecc5a14a4829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d766e250-2d86-4e68-abc1-ecc5a14a4829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2116832218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f00864-1525-4f6b-a949-8c35fc960901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c241553320f34b27a4142cddd82cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:56Z,use_quota=True,user_id='be12064d38004856a90fa311ccd97aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8fb5df-912e-4be1-a32b-3f49cc722e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8fb5df-912e-4be1-a32b-3f49cc722e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f197cb-6704-4206-8bf3-8ac2fd349d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f197cb-6704-4206-8bf3-8ac2fd349d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f00864-1525-4f6b-a949-8c35fc960901', 'volume_name': 'volume-a4f00864-1525-4f6b-a949-8c35fc960901', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c6a07c-b3b6-465d-a4bf-7efad2e9c833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c6a07c-b3b6-465d-a4bf-7efad2e9c833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fd7afa-4133-40f1-bc77-cef9e39a8f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:55 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Volume a4f00864-1525-4f6b-a949-8c35fc960901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f00864-1525-4f6b-a949-8c35fc960901', 'volume_size': 1} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2116832218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f00864-1525-4f6b-a949-8c35fc960901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c241553320f34b27a4142cddd82cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:09:56Z,use_quota=True,user_id='be12064d38004856a90fa311ccd97aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Creating volume a4f00864-1525-4f6b-a949-8c35fc960901 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:09:55 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:55 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901 1073741824 Aug 26 12:09:55 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:55 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835" returned: 0 in 0.619s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:55 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835 Aug 26 12:09:55 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:56 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6.bbb7debb-cade-4d63-a39e-ec113c86e835" returned: 0 in 0.654s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-bbb7debb-cade-4d63-a39e-ec113c86e835" released by "_delete_snapshot" :: held 3.370s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-82550d68-2e7a-4dce-9348-8cf168234be6" released by "delete_snapshot" :: held 3.430s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:56 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901 1073741824" returned: 0 in 0.948s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:56 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Created reservations ['48ce6764-d6a8-4628-97ef-579921ecf9fa', 'e4b4a9f6-6882-4e27-8689-980fa0c5c5bb', '93bf48cc-cc1e-432d-8d03-35b2ba4225fb', '5cb8b0f5-28d2-4509-870c-c133e6f83552'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:09:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:56 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901 Aug 26 12:09:56 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:56 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Delete snapshot completed successfully. Aug 26 12:09:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-dcd07142-27a7-42bf-9f47-814653a8c222 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-bbb7debb-cade-4d63-a39e-ec113c86e835-delete_snapshot" released by "delete_snapshot" :: held 3.766s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:57 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901" returned: 0 in 0.426s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fd7afa-4133-40f1-bc77-cef9e39a8f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f00864-1525-4f6b-a949-8c35fc960901', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83e3902-46da-438d-95f3-4fb604d4a7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:09:57 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Volume volume-a4f00864-1525-4f6b-a949-8c35fc960901 (a4f00864-1525-4f6b-a949-8c35fc960901): created successfully Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83e3902-46da-438d-95f3-4fb604d4a7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Flow 'volume_create_manager' (e2739c08-237c-4b76-88ed-bc4302245051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:09:57 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3f4bd3d7-721c-4fdb-a39a-892188be9d7b tempest-VolumesNegativeTest-1472886159 None] Created volume successfully. Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-82550d68-2e7a-4dce-9348-8cf168234be6-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-82550d68-2e7a-4dce-9348-8cf168234be6-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-82550d68-2e7a-4dce-9348-8cf168234be6" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-82550d68-2e7a-4dce-9348-8cf168234be6" acquired by "delete_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d07217c-9106-4a97-b97f-871307373722]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:09:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:58 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 Aug 26 12:09:58 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:58 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6" returned: 0 in 0.515s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:58 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6 Aug 26 12:09:58 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:58 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82550d68-2e7a-4dce-9348-8cf168234be6" returned: 0 in 0.445s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-82550d68-2e7a-4dce-9348-8cf168234be6" released by "delete_volume" :: held 1.080s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:09:58 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Created reservations ['b4e0d3ff-26cb-41aa-ba38-16739b21fb4a', '0d4a2de2-78a2-4455-989b-93b0028e673b', '509fa151-7573-4ce1-98de-61b4a6b6c093', '05e68786-0753-4ba2-8929-52b61d8eab20'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:09:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:09:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:09:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:09:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:09:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:09:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:09:59 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:09:59 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:09:59 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Aug 26 12:09:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.747s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:09:59 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:09:59 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Deleted volume successfully. Aug 26 12:09:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a24f3953-5fd4-4b9f-852a-b445cd319ffe tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-82550d68-2e7a-4dce-9348-8cf168234be6-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (7429ad58-daf8-4d47-88e8-f4286e155d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9217c5-6369-4771-a924-9dfcec8b82e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9217c5-6369-4771-a924-9dfcec8b82e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-271249624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7804e744-8847-40df-b2c0-47358590fffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e4401392474b8cbec19aaf7cb21093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:10:01Z,use_quota=True,user_id='5834cf6496324cce81c73bf8a025683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553c82ad-22f7-4fec-a583-c7cf5c52556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553c82ad-22f7-4fec-a583-c7cf5c52556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe653f6-fb4e-4667-8942-fdfb3bf5a96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe653f6-fb4e-4667-8942-fdfb3bf5a96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7804e744-8847-40df-b2c0-47358590fffa', 'volume_name': 'volume-7804e744-8847-40df-b2c0-47358590fffa', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca852f8f-d3d2-4563-bb2b-3fc6e5094bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca852f8f-d3d2-4563-bb2b-3fc6e5094bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05aefdf5-0186-4fec-b7eb-b6d81a6b68e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:01 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Volume 7804e744-8847-40df-b2c0-47358590fffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7804e744-8847-40df-b2c0-47358590fffa', 'volume_size': 1} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-271249624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7804e744-8847-40df-b2c0-47358590fffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e4401392474b8cbec19aaf7cb21093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:10:01Z,use_quota=True,user_id='5834cf6496324cce81c73bf8a025683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Creating volume 7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:10:01 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:10:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:01 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa 1073741824 Aug 26 12:10:01 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:02 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa 1073741824" returned: 0 in 0.864s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:02 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa Aug 26 12:10:02 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:02 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa" returned: 0 in 0.338s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:10:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05aefdf5-0186-4fec-b7eb-b6d81a6b68e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7804e744-8847-40df-b2c0-47358590fffa', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3c90f4-34ba-4a8e-bff3-4d32c2c9606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:02 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Volume volume-7804e744-8847-40df-b2c0-47358590fffa (7804e744-8847-40df-b2c0-47358590fffa): created successfully Aug 26 12:10:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3c90f4-34ba-4a8e-bff3-4d32c2c9606f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (7429ad58-daf8-4d47-88e8-f4286e155d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ee6768c9-9a7b-4908-b433-e93f5222cad0 tempest-VolumesSnapshotTestJSON-479568879 None] Created volume successfully. Aug 26 12:10:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Creating offline snapshot 3be4eab6-1007-4dd3-9535-2e1d159f0988 of volume 7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:10:03 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc02d6b-b807-46eb-a90c-5956069d6a40]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:03 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa Aug 26 12:10:04 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:04 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa" returned: 0 in 0.576s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:04 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 1G Aug 26 12:10:04 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:05 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 1G" returned: 0 in 0.676s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7804e744-8847-40df-b2c0-47358590fffa -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:05 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7804e744-8847-40df-b2c0-47358590fffa -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 Aug 26 12:10:05 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:05 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7804e744-8847-40df-b2c0-47358590fffa -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988" returned: 0 in 0.397s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:05 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 is being set with open permissions: ugo+rw Aug 26 12:10:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:05 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 Aug 26 12:10:05 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:05 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988" returned: 0 in 0.523s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:06 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.info Aug 26 12:10:06 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:06 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.info" returned: 0 in 0.459s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:06 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.info is being set with open permissions: ugo+rw Aug 26 12:10:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:06 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.info Aug 26 12:10:06 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:07 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.info" returned: 0 in 0.533s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.339s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:07 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=88,cinder:UPDATE=102,cinder:DELETE=10,cinder:INSERT=24 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:10:07 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=104,cinder:UPDATE=101,cinder:INSERT=31,cinder:DELETE=9 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:10:07 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1f41d222-c687-43a9-93a4-32c55b2b12b2 tempest-VolumesSnapshotTestJSON-479568879 None] Create snapshot completed successfully Aug 26 12:10:08 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (438fd1eb-6790-4933-95b8-1bbbdb0c5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1145a309-d539-4b21-ade0-dde82474c398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1145a309-d539-4b21-ade0-dde82474c398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1433453428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7b47f3-b49a-4124-b631-46ec8a486e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e4401392474b8cbec19aaf7cb21093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3be4eab6-1007-4dd3-9535-2e1d159f0988,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:10:09Z,use_quota=True,user_id='5834cf6496324cce81c73bf8a025683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f63d1d-b166-4338-a18b-9efaedf7dcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f63d1d-b166-4338-a18b-9efaedf7dcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958bc2bc-26f9-4248-b613-558f7612e697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958bc2bc-26f9-4248-b613-558f7612e697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b7b47f3-b49a-4124-b631-46ec8a486e12', 'volume_name': 'volume-3b7b47f3-b49a-4124-b631-46ec8a486e12', 'volume_size': 1, 'snapshot_id': '3be4eab6-1007-4dd3-9535-2e1d159f0988'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7fdb2f-d18e-4275-b782-2824e7aa8d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7fdb2f-d18e-4275-b782-2824e7aa8d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac59ab52-642a-4a7f-aaee-bc07ffe407d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:09 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Volume 3b7b47f3-b49a-4124-b631-46ec8a486e12: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b7b47f3-b49a-4124-b631-46ec8a486e12', 'volume_size': 1, 'snapshot_id': '3be4eab6-1007-4dd3-9535-2e1d159f0988'} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-3be4eab6-1007-4dd3-9535-2e1d159f0988-3b7b47f3-b49a-4124-b631-46ec8a486e12" by "_create_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-3be4eab6-1007-4dd3-9535-2e1d159f0988-3b7b47f3-b49a-4124-b631-46ec8a486e12" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Creating volume 3b7b47f3-b49a-4124-b631-46ec8a486e12 from snapshot 3be4eab6-1007-4dd3-9535-2e1d159f0988 {{(pid=94387) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-3b7b47f3-b49a-4124-b631-46ec8a486e12" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-3b7b47f3-b49a-4124-b631-46ec8a486e12" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] snapshot: 3be4eab6-1007-4dd3-9535-2e1d159f0988, volume: 3b7b47f3-b49a-4124-b631-46ec8a486e12, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[68518b67-d11b-4c33-8174-85269ed6be9a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:09 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 Aug 26 12:10:09 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:09 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988" returned: 0 in 0.654s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7804e744-8847-40df-b2c0-47358590fffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd23a03e-29a6-4a08-a517-9ab9d18bb7fc]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:10 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa Aug 26 12:10:10 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:10 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa" returned: 0 in 0.608s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:10:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:10 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:10:10 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:10 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 Aug 26 12:10:10 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:10 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.444s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:10:11 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:10:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:10:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:10:18 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12" returned: 0 in 8.013s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:18 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa, size 1024.00 MB, duration 8.01 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:10:18 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Converted 1024.00 MB image at 127.78 MB/s Aug 26 12:10:18 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 is being set with open permissions: ugo+rw Aug 26 12:10:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:18 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 Aug 26 12:10:18 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:18 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12" returned: 0 in 0.337s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-3b7b47f3-b49a-4124-b631-46ec8a486e12" released by "_copy_volume_from_snapshot" :: held 9.755s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-3be4eab6-1007-4dd3-9535-2e1d159f0988-3b7b47f3-b49a-4124-b631-46ec8a486e12" released by "_create_volume_from_snapshot" :: held 9.880s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.909s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac59ab52-642a-4a7f-aaee-bc07ffe407d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7b47f3-b49a-4124-b631-46ec8a486e12', 'volume_size': 1, 'snapshot_id': '3be4eab6-1007-4dd3-9535-2e1d159f0988'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11683e3f-4adb-44d6-9e99-922f3ac52b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:19 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Volume volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 (3b7b47f3-b49a-4124-b631-46ec8a486e12): created successfully Aug 26 12:10:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11683e3f-4adb-44d6-9e99-922f3ac52b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Flow 'volume_create_manager' (438fd1eb-6790-4933-95b8-1bbbdb0c5c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:19 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-25f18a3c-b8b2-4ca9-95b9-5dea219814ff tempest-VolumesSnapshotTestJSON-479568879 None] Created volume successfully. Aug 26 12:10:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-3b7b47f3-b49a-4124-b631-46ec8a486e12-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-3b7b47f3-b49a-4124-b631-46ec8a486e12-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-3b7b47f3-b49a-4124-b631-46ec8a486e12" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-3b7b47f3-b49a-4124-b631-46ec8a486e12" acquired by "delete_volume" :: waited 0.042s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:20 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8618eb-2b43-4c78-828d-f0af538cd0d0]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:20 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 Aug 26 12:10:20 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:20 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12" returned: 0 in 0.554s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:20 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12 Aug 26 12:10:20 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:21 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3b7b47f3-b49a-4124-b631-46ec8a486e12" returned: 0 in 0.319s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-3b7b47f3-b49a-4124-b631-46ec8a486e12" released by "delete_volume" :: held 1.000s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Created reservations ['c0425372-4bc5-46fb-baab-6ae9fd2e44ee', 'f2faae04-14b0-4477-adac-67626d507e29', '37f1eb00-5695-4c0f-aacb-d580e93580c9', 'db4ac50d-043d-4f73-8dbf-b6b079d0cde5'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:21 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:10:21 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:21 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.478s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:10:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Deleted volume successfully. Aug 26 12:10:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-29a20186-6616-44e9-9623-b78ffdeb00be tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-3b7b47f3-b49a-4124-b631-46ec8a486e12-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-3be4eab6-1007-4dd3-9535-2e1d159f0988-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-3be4eab6-1007-4dd3-9535-2e1d159f0988-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-7804e744-8847-40df-b2c0-47358590fffa" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-7804e744-8847-40df-b2c0-47358590fffa" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-3be4eab6-1007-4dd3-9535-2e1d159f0988" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-3be4eab6-1007-4dd3-9535-2e1d159f0988" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Deleting offline snapshot 3be4eab6-1007-4dd3-9535-2e1d159f0988 of volume 7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] snapshot_file for this snap is: volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[4479051a-1d29-4567-83cf-9d43f1405dba]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:22 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 Aug 26 12:10:22 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:23 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988" returned: 0 in 0.583s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7804e744-8847-40df-b2c0-47358590fffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:10:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5338e0f7-7790-4c62-8588-f48321d8a60d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:23 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa Aug 26 12:10:23 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:24 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa" returned: 0 in 0.738s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:24 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 Aug 26 12:10:24 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:24 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988" returned: 0 in 0.607s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:24 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988 Aug 26 12:10:24 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:25 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa.3be4eab6-1007-4dd3-9535-2e1d159f0988" returned: 0 in 0.537s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-3be4eab6-1007-4dd3-9535-2e1d159f0988" released by "_delete_snapshot" :: held 2.628s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-7804e744-8847-40df-b2c0-47358590fffa" released by "delete_snapshot" :: held 2.684s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:25 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Created reservations ['72b19e71-c5ae-463b-a87d-2393932428cf', '1932b25b-29fe-415f-b367-5e4a74e7297c', '49c22cbe-0a09-49a5-b9a6-a64dc541a2f3', '711f5769-23d2-44d3-851e-99ad8e643961'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:10:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Delete snapshot completed successfully. Aug 26 12:10:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6dddca8a-2370-4405-a7d3-0bf4cd14a52b tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-3be4eab6-1007-4dd3-9535-2e1d159f0988-delete_snapshot" released by "delete_snapshot" :: held 3.005s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-7804e744-8847-40df-b2c0-47358590fffa-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-7804e744-8847-40df-b2c0-47358590fffa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-7804e744-8847-40df-b2c0-47358590fffa" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-7804e744-8847-40df-b2c0-47358590fffa" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da7fe9e-bd57-44a4-b4b1-bb19be2a0a61]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:26 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa Aug 26 12:10:26 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:26 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa" returned: 0 in 0.470s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:26 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa Aug 26 12:10:26 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:26 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7804e744-8847-40df-b2c0-47358590fffa" returned: 0 in 0.329s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-7804e744-8847-40df-b2c0-47358590fffa" released by "delete_volume" :: held 0.918s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Created reservations ['cc11ea76-b944-416e-ab17-55b9e2aa1dcf', 'dcac3fe4-d42a-4f7e-a38e-41bc3f5b9a2a', 'b1a006fa-38d4-4ed9-89cd-0d196707464a', 'df46ee80-5707-460a-984d-dc7792ff006e'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:27 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:10:27 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:27 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.362s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:10:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Deleted volume successfully. Aug 26 12:10:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3f7edb10-8019-452d-941a-062ef8e9ebd1 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-7804e744-8847-40df-b2c0-47358590fffa-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-2284f500-df70-4bda-941c-1d59a1f3f2a5-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-2284f500-df70-4bda-941c-1d59a1f3f2a5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "cinder-quobyte-2284f500-df70-4bda-941c-1d59a1f3f2a5" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-2284f500-df70-4bda-941c-1d59a1f3f2a5" acquired by "delete_volume" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:28 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e22bd4-5267-43e5-8374-e553581727db]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:28 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 Aug 26 12:10:28 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:29 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5" returned: 0 in 0.505s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:29 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5 Aug 26 12:10:29 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:29 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2284f500-df70-4bda-941c-1d59a1f3f2a5" returned: 0 in 0.289s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-quobyte-2284f500-df70-4bda-941c-1d59a1f3f2a5" released by "delete_volume" :: held 0.887s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Created reservations ['ab89272c-d652-4cec-a7c2-3a714662ca04', 'a21de489-f8eb-4ef4-a376-f0f3ddf3a7e8', 'bce3e762-49b8-4fcd-bbc9-d67728f42811', 'c5791094-72ac-4e90-922d-db3cd54d8034'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:29 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:10:29 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:29 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.309s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:29 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:10:29 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Deleted volume successfully. Aug 26 12:10:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-02efee54-2910-4164-b105-0e4704d53105 tempest-VolumesSnapshotTestJSON-479568879 None] Lock "cinder-2284f500-df70-4bda-941c-1d59a1f3f2a5-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-6829f1d2-17cd-45aa-b513-a47a643b47b2 req-041559be-7b1b-4b03-b44a-301c20553160 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-6829f1d2-17cd-45aa-b513-a47a643b47b2 req-041559be-7b1b-4b03-b44a-301c20553160 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-6829f1d2-17cd-45aa-b513-a47a643b47b2 req-041559be-7b1b-4b03-b44a-301c20553160 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-6829f1d2-17cd-45aa-b513-a47a643b47b2 req-041559be-7b1b-4b03-b44a-301c20553160 tempest-TestInstancesWithCinderVolumes-295371566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9afee7f3-4f80-404a-9c9d-bbf8d81e86be', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:10:32 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-6829f1d2-17cd-45aa-b513-a47a643b47b2 req-041559be-7b1b-4b03-b44a-301c20553160 tempest-TestInstancesWithCinderVolumes-295371566 None] attachment_update completed successfully. Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Acquiring lock "cinder-a4f00864-1525-4f6b-a949-8c35fc960901-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Lock "cinder-a4f00864-1525-4f6b-a949-8c35fc960901-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Acquiring lock "cinder-quobyte-a4f00864-1525-4f6b-a949-8c35fc960901" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Lock "cinder-quobyte-a4f00864-1525-4f6b-a949-8c35fc960901" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[8251ad6d-3a20-41fd-9c6b-fb30693d99e9]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:35 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901 Aug 26 12:10:35 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-ddd90849-334f-4d70-a29c-005ac346d8e1 req-3c176008-2992-4e7f-bd32-5b375d6bc751 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-ddd90849-334f-4d70-a29c-005ac346d8e1 req-3c176008-2992-4e7f-bd32-5b375d6bc751 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-ddd90849-334f-4d70-a29c-005ac346d8e1 req-3c176008-2992-4e7f-bd32-5b375d6bc751 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-ddd90849-334f-4d70-a29c-005ac346d8e1 req-3c176008-2992-4e7f-bd32-5b375d6bc751 tempest-TestInstancesWithCinderVolumes-295371566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f8963fc-a40a-47e8-8dce-391acda19ec8', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:10:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-ddd90849-334f-4d70-a29c-005ac346d8e1 req-3c176008-2992-4e7f-bd32-5b375d6bc751 tempest-TestInstancesWithCinderVolumes-295371566 None] attachment_update completed successfully. Aug 26 12:10:36 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901" returned: 0 in 0.490s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:36 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901 Aug 26 12:10:36 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:36 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a4f00864-1525-4f6b-a949-8c35fc960901" returned: 0 in 0.429s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Lock "cinder-quobyte-a4f00864-1525-4f6b-a949-8c35fc960901" released by "delete_volume" :: held 1.012s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Created reservations ['f8c520f1-9710-411d-845e-e763f81e599d', 'ac5937e8-ecee-454d-9d34-ab35e5a2833c', '9a978d7e-d882-4043-90b0-e25eabb9396c', '659314bd-5f25-4ed0-8e42-91b21f3788a0'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:36 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:10:36 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:37 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.364s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:37 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:10:37 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Deleted volume successfully. Aug 26 12:10:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9a92168-dbba-4cfc-a6b4-6df63e8300a6 tempest-VolumesNegativeTest-1472886159 None] Lock "cinder-a4f00864-1525-4f6b-a949-8c35fc960901-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Flow 'volume_create_manager' (fdff9294-3372-47d6-9199-fec6f895d358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d19f3c-48d3-4ea2-8f02-ff1badc6185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d19f3c-48d3-4ea2-8f02-ff1badc6185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1789946398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ae78b3-af8e-4d63-b600-a70cd56b9534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e72c01148a404ab9910c1262de2787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:10:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:10:42Z,use_quota=True,user_id='66aca4597bd740bbbb136c68e218779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd06aaf7-2c03-4cd7-a422-0952ac5cb3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd06aaf7-2c03-4cd7-a422-0952ac5cb3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c94329e-f91d-43cb-b176-836e49c3d868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c94329e-f91d-43cb-b176-836e49c3d868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ae78b3-af8e-4d63-b600-a70cd56b9534', 'volume_name': 'volume-12ae78b3-af8e-4d63-b600-a70cd56b9534', 'volume_size': 2}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61b7ce6-8fb1-4f3b-8124-52f6b7c6472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61b7ce6-8fb1-4f3b-8124-52f6b7c6472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f4b462-f214-4f32-96a8-1ffd11d7c930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:41 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Volume 12ae78b3-af8e-4d63-b600-a70cd56b9534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ae78b3-af8e-4d63-b600-a70cd56b9534', 'volume_size': 2} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1789946398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ae78b3-af8e-4d63-b600-a70cd56b9534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e72c01148a404ab9910c1262de2787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:10:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:10:42Z,use_quota=True,user_id='66aca4597bd740bbbb136c68e218779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Creating volume 12ae78b3-af8e-4d63-b600-a70cd56b9534 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:10:41 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:10:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 2147483648 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:41 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 2147483648 Aug 26 12:10:41 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:42 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 2147483648" returned: 0 in 0.905s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:42 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 Aug 26 12:10:42 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Flow 'volume_create_manager' (9f28c41b-5817-4847-8a74-766919fab443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fa43b5-f7c0-468c-9068-2140363f845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fa43b5-f7c0-468c-9068-2140363f845f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-536383504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747d812b-f011-44de-99ee-4343b998e425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efcec3ef81440df808e65c62389d499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:10:43Z,use_quota=True,user_id='fbc5466be98a47a1a55660a4571acf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5307f75-a872-4c82-bab4-ba17a8ff1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5307f75-a872-4c82-bab4-ba17a8ff1f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31779283-5bf9-4dbf-92e0-f37aa53a579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31779283-5bf9-4dbf-92e0-f37aa53a579d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747d812b-f011-44de-99ee-4343b998e425', 'volume_name': 'volume-747d812b-f011-44de-99ee-4343b998e425', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c71a56d-7d1a-4e29-846f-90d09192a004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c71a56d-7d1a-4e29-846f-90d09192a004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb53359c-a719-4711-b88a-94d5f295ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Volume 747d812b-f011-44de-99ee-4343b998e425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747d812b-f011-44de-99ee-4343b998e425', 'volume_size': 1} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:43 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534" returned: 0 in 0.441s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-536383504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747d812b-f011-44de-99ee-4343b998e425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efcec3ef81440df808e65c62389d499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:10:43Z,use_quota=True,user_id='fbc5466be98a47a1a55660a4571acf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Creating volume 747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:10:43 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f4b462-f214-4f32-96a8-1ffd11d7c930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ae78b3-af8e-4d63-b600-a70cd56b9534', 'volume_size': 2}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77844ca3-7da5-49fc-94e1-cc0adb25ffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 1073741824 Aug 26 12:10:43 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Volume volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 (12ae78b3-af8e-4d63-b600-a70cd56b9534): created successfully Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77844ca3-7da5-49fc-94e1-cc0adb25ffeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Flow 'volume_create_manager' (fdff9294-3372-47d6-9199-fec6f895d358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Flow 'volume_create_manager' (6d005166-9ff7-4f1d-af12-a2f131cff580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7300532-a231-4009-9da9-2b78b2153d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-304f2f09-0ba0-43ec-954c-b651549bb5a5 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Created volume successfully. Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7300532-a231-4009-9da9-2b78b2153d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1382708614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb9b495-d0b4-4c75-ba27-5b5645ed01a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69af2f6a406e42e5847bcbfe7f1110af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:10:43Z,use_quota=True,user_id='7b4ae769054c44d4a13a238b18c3843e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc40333-58dc-48ec-b7a7-3d352426589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc40333-58dc-48ec-b7a7-3d352426589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9f9adb-d023-4ad6-99c1-3552b124d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9f9adb-d023-4ad6-99c1-3552b124d72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb9b495-d0b4-4c75-ba27-5b5645ed01a7', 'volume_name': 'volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860dcfaf-8bf0-41a7-9bda-01dc10d256e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860dcfaf-8bf0-41a7-9bda-01dc10d256e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17af9887-5ab3-4f1a-9bc0-8e2ded2144b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Volume ceb9b495-d0b4-4c75-ba27-5b5645ed01a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7', 'volume_size': 1} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-d9be3031-f4d0-41be-929b-ca38ef2f13f6 req-bc3c5a07-dce1-4c73-bdf0-444f513001dd tempest-TestInstancesWithCinderVolumes-295371566 None] Terminate volume connection completed successfully. Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-d9be3031-f4d0-41be-929b-ca38ef2f13f6 req-bc3c5a07-dce1-4c73-bdf0-444f513001dd tempest-TestInstancesWithCinderVolumes-295371566 None] Deleting attachment 9afee7f3-4f80-404a-9c9d-bbf8d81e86be. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:10:43 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 1073741824" returned: 0 in 0.585s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:44 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 Aug 26 12:10:44 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:44 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425" returned: 0 in 0.416s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1382708614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb9b495-d0b4-4c75-ba27-5b5645ed01a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69af2f6a406e42e5847bcbfe7f1110af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:10:43Z,use_quota=True,user_id='7b4ae769054c44d4a13a238b18c3843e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Creating volume ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:10:44 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:44 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 1073741824 Aug 26 12:10:44 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb53359c-a719-4711-b88a-94d5f295ab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747d812b-f011-44de-99ee-4343b998e425', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c582339f-eb90-4abc-a439-f8e8b9d06eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:44 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Volume volume-747d812b-f011-44de-99ee-4343b998e425 (747d812b-f011-44de-99ee-4343b998e425): created successfully Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c582339f-eb90-4abc-a439-f8e8b9d06eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Flow 'volume_create_manager' (9f28c41b-5817-4847-8a74-766919fab443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4ed7ac99-cfc1-45af-84dc-8fcbd0e1cf73 tempest-VolumesSnapshotListTestJSON-1092123505 None] Created volume successfully. Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "cinder-f153e7bf-a909-4d00-87ce-6c9f07dd272c-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-f153e7bf-a909-4d00-87ce-6c9f07dd272c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "cinder-quobyte-f153e7bf-a909-4d00-87ce-6c9f07dd272c" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-quobyte-f153e7bf-a909-4d00-87ce-6c9f07dd272c" acquired by "delete_volume" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[88697110-1d11-4fd6-a5ed-86c101ee3145]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:44 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c Aug 26 12:10:44 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:45 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 1073741824" returned: 0 in 0.633s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:45 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 Aug 26 12:10:45 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:45 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c" returned: 0 in 0.597s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:45 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c Aug 26 12:10:45 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:45 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7" returned: 0 in 0.375s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.140s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17af9887-5ab3-4f1a-9bc0-8e2ded2144b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e367613b-6bf5-497e-b8cc-4763ab8741aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Creating offline snapshot ee86145c-c5d9-4bef-aae5-b4adc41fa393 of volume 12ae78b3-af8e-4d63-b600-a70cd56b9534 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:10:45 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Volume volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 (ceb9b495-d0b4-4c75-ba27-5b5645ed01a7): created successfully Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e367613b-6bf5-497e-b8cc-4763ab8741aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Flow 'volume_create_manager' (6d005166-9ff7-4f1d-af12-a2f131cff580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9030920-42b6-45f2-9996-bff7ebecfb0b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:45 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f153e7bf-a909-4d00-87ce-6c9f07dd272c" returned: 0 in 0.343s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:45 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b95e85e3-af7c-42c8-9da8-251578f707e3 tempest-TestMinimumBasicScenario-1515078605 None] Created volume successfully. Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-quobyte-f153e7bf-a909-4d00-87ce-6c9f07dd272c" released by "delete_volume" :: held 1.007s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:45 devstack cinder-volume[94387]: WARNING cinder.quota [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1863052239-1819424853 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1863052239-1819424853, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:10:45 devstack cinder-volume[94387]: WARNING cinder.quota [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1863052239-1819424853 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1863052239-1819424853, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Created reservations ['0d3b93b1-c73c-4cad-8fce-8eab3f56bff4', '43e54444-a8a2-48b8-9c00-052ed415204e', '1648d1d0-1bf6-4d08-b9bf-fba2480adc3e', '87b50626-1d9b-448d-8b9a-23514a84d787'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:10:45 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 Aug 26 12:10:45 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:45 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:10:45 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:46 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534" returned: 0 in 0.471s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 2G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:46 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 2G Aug 26 12:10:46 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:46 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.308s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:46 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:10:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Deleted volume successfully. Aug 26 12:10:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7e99bc5c-2d0d-4ed5-ab9b-17e630ff0c52 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-f153e7bf-a909-4d00-87ce-6c9f07dd272c-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:46 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 2G" returned: 0 in 0.503s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:46 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 Aug 26 12:10:46 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:47 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393" returned: 0 in 0.496s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:47 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 is being set with open permissions: ugo+rw Aug 26 12:10:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:47 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 Aug 26 12:10:47 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:47 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393" returned: 0 in 0.322s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:47 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.info Aug 26 12:10:47 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-e977459c-bb85-4e8d-8e19-617bb8ea0e62 req-45572b3a-b925-41b4-ac7f-20831708de92 tempest-TestMinimumBasicScenario-1515078605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:47 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.info" returned: 0 in 0.320s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:47 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.info is being set with open permissions: ugo+rw Aug 26 12:10:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:47 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.info Aug 26 12:10:47 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:48 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.info" returned: 0 in 0.267s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.821s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Creating offline snapshot 19b0f8b4-15e2-4c9a-abca-6e32b0127fab of volume 747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:10:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6db14650-2262-4032-b786-7663fb108349 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Create snapshot completed successfully Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf27546a-c9a2-42a1-974b-feb40d41c0ca]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:48 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 Aug 26 12:10:48 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:48 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425" returned: 0 in 0.416s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:48 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab 1G Aug 26 12:10:48 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Acquiring lock "cinder-ee86145c-c5d9-4bef-aae5-b4adc41fa393-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-ee86145c-c5d9-4bef-aae5-b4adc41fa393-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Acquiring lock "cinder-quobyte-12ae78b3-af8e-4d63-b600-a70cd56b9534" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-quobyte-12ae78b3-af8e-4d63-b600-a70cd56b9534" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Acquiring lock "cinder-quobyte-ee86145c-c5d9-4bef-aae5-b4adc41fa393" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-quobyte-ee86145c-c5d9-4bef-aae5-b4adc41fa393" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Deleting offline snapshot ee86145c-c5d9-4bef-aae5-b4adc41fa393 of volume 12ae78b3-af8e-4d63-b600-a70cd56b9534 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] snapshot_file for this snap is: volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf44f28-854d-4aef-8874-a5e4bb6a1491]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:49 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 Aug 26 12:10:49 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:49 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab 1G" returned: 0 in 0.564s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d812b-f011-44de-99ee-4343b998e425 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:49 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d812b-f011-44de-99ee-4343b998e425 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab Aug 26 12:10:49 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:49 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393" returned: 0 in 0.461s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ae78b3-af8e-4d63-b600-a70cd56b9534(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b98ade-8935-4fbe-8f88-410268bf769b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:49 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d812b-f011-44de-99ee-4343b998e425 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab" returned: 0 in 0.388s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:49 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab is being set with open permissions: ugo+rw Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:49 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab Aug 26 12:10:49 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-d0c47786-a038-4051-b974-f969f047be31 req-5481738c-e85d-4aae-a31d-a5072f384abd tempest-TestInstancesWithCinderVolumes-295371566 None] Terminate volume connection completed successfully. Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-d0c47786-a038-4051-b974-f969f047be31 req-5481738c-e85d-4aae-a31d-a5072f384abd tempest-TestInstancesWithCinderVolumes-295371566 None] Deleting attachment 0f8963fc-a40a-47e8-8dce-391acda19ec8. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:10:49 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 Aug 26 12:10:49 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:49 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab" returned: 0 in 0.292s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:49 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.info Aug 26 12:10:49 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:49 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534" returned: 0 in 0.488s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:49 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 Aug 26 12:10:49 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "cinder-584fcdae-3e5c-49f4-928a-88d7195e5c5b-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-584fcdae-3e5c-49f4-928a-88d7195e5c5b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:50 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.info" returned: 0 in 0.363s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:50 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.info is being set with open permissions: ugo+rw Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:50 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.info Aug 26 12:10:50 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "cinder-quobyte-584fcdae-3e5c-49f4-928a-88d7195e5c5b" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-quobyte-584fcdae-3e5c-49f4-928a-88d7195e5c5b" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[730aa088-ac24-443c-ac66-1436f508a25e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:50 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393" returned: 0 in 0.578s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:50 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b Aug 26 12:10:50 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:50 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393 Aug 26 12:10:50 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:50 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.info" returned: 0 in 0.432s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-e977459c-bb85-4e8d-8e19-617bb8ea0e62 req-45572b3a-b925-41b4-ac7f-20831708de92 tempest-TestMinimumBasicScenario-1515078605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.056s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-e977459c-bb85-4e8d-8e19-617bb8ea0e62 req-45572b3a-b925-41b4-ac7f-20831708de92 tempest-TestMinimumBasicScenario-1515078605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-96972477-5ff6-480d-93ae-f1480b96fd3b tempest-VolumesSnapshotListTestJSON-1092123505 None] Create snapshot completed successfully Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-e977459c-bb85-4e8d-8e19-617bb8ea0e62 req-45572b3a-b925-41b4-ac7f-20831708de92 tempest-TestMinimumBasicScenario-1515078605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adc0d2c8-ad89-49f3-92fe-024b3817abca', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:10:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-e977459c-bb85-4e8d-8e19-617bb8ea0e62 req-45572b3a-b925-41b4-ac7f-20831708de92 tempest-TestMinimumBasicScenario-1515078605 None] attachment_update completed successfully. Aug 26 12:10:50 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534.ee86145c-c5d9-4bef-aae5-b4adc41fa393" returned: 0 in 0.444s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:51 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-quobyte-ee86145c-c5d9-4bef-aae5-b4adc41fa393" released by "_delete_snapshot" :: held 2.142s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b" returned: 0 in 0.712s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-quobyte-12ae78b3-af8e-4d63-b600-a70cd56b9534" released by "delete_snapshot" :: held 2.201s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:51 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b Aug 26 12:10:51 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Created reservations ['1c2f3357-8605-4a69-b326-d1acf502b6e9', 'c4967354-10bb-4e67-8cd5-f0a428abd664', '0f1d0bf5-758f-4a9c-9137-05846d84620f', '60fc90db-067f-44ec-91d8-fba8b2fe5995'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:10:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Delete snapshot completed successfully. Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e18e4181-2437-4c63-ac15-c8c8fd061f13 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-ee86145c-c5d9-4bef-aae5-b4adc41fa393-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:51 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-584fcdae-3e5c-49f4-928a-88d7195e5c5b" returned: 0 in 0.472s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-quobyte-584fcdae-3e5c-49f4-928a-88d7195e5c5b" released by "delete_volume" :: held 1.282s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:51 devstack cinder-volume[94387]: WARNING cinder.quota [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1305382729-154209814 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1305382729-154209814, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:10:51 devstack cinder-volume[94387]: WARNING cinder.quota [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1305382729-154209814 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1305382729-154209814, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Created reservations ['e4463c9b-c20b-4777-80d6-5d75e6b89c00', 'eb1d1973-1cf7-4374-a6a5-9b8790f4a3cb', '9d590cab-fb8f-443f-99e5-5fd23e02e336', 'ba4f9ef6-4559-4c79-a68b-805db396de5e'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:51 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:10:51 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Acquiring lock "cinder-12ae78b3-af8e-4d63-b600-a70cd56b9534-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:52 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-12ae78b3-af8e-4d63-b600-a70cd56b9534-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.449s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:10:52 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Deleted volume successfully. Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Creating offline snapshot 4c717018-ecab-4a03-8fd1-7429972f6cea of volume 747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d405c13-7f3d-49dd-89f2-8b5396c61896]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Acquiring lock "cinder-quobyte-12ae78b3-af8e-4d63-b600-a70cd56b9534" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e79f7909-632d-4616-89e4-99cbf78e6c22 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-584fcdae-3e5c-49f4-928a-88d7195e5c5b-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-quobyte-12ae78b3-af8e-4d63-b600-a70cd56b9534" acquired by "delete_volume" :: waited 0.040s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ff2147-4781-4391-a923-69c988e66970]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:52 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab Aug 26 12:10:52 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:52 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 Aug 26 12:10:52 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:53 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534" returned: 0 in 0.618s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:53 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534 Aug 26 12:10:53 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:53 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab" returned: 0 in 0.873s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747d812b-f011-44de-99ee-4343b998e425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:10:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:53 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea 1G Aug 26 12:10:53 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:53 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-12ae78b3-af8e-4d63-b600-a70cd56b9534" returned: 0 in 0.537s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-quobyte-12ae78b3-af8e-4d63-b600-a70cd56b9534" released by "delete_volume" :: held 1.247s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:53 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Created reservations ['73485088-c5ef-4132-9b0e-e67f19296cb2', 'f32e8df3-3c16-4d56-9765-9dab7e6970de', 'a6598728-1e3e-407a-8ae6-a08ba42f8a2c', 'f4782e78-c479-4a6e-8890-f956755d348f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:54 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea 1G" returned: 0 in 0.713s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:54 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:10:54 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:54 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea Aug 26 12:10:54 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:54 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.402s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:10:54 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Deleted volume successfully. Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4880edad-2a34-4129-b7da-397d7cb5a511 tempest-VolumesSnapshotNegativeTestJSON-713068243 None] Lock "cinder-12ae78b3-af8e-4d63-b600-a70cd56b9534-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:10:54 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea" returned: 0 in 0.544s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:54 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea is being set with open permissions: ugo+rw Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:54 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea Aug 26 12:10:54 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:54 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea" returned: 0 in 0.334s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:55 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-45c29fef-33ef-4c73-bacc-e6b936f4eb9a tempest-VolumesSnapshotListTestJSON-1092123505 None] Create snapshot completed successfully Aug 26 12:10:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:10:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:10:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Creating offline snapshot 2c515e6e-de1e-4797-8955-df6f8e8395fb of volume 747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:10:56 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[76487051-aea6-4f20-bf5b-e1be0c43981b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:10:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:56 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea Aug 26 12:10:56 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:56 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea" returned: 0 in 0.547s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747d812b-f011-44de-99ee-4343b998e425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:10:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:56 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb 1G Aug 26 12:10:56 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:57 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb 1G" returned: 0 in 0.636s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:57 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb Aug 26 12:10:57 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:57 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb" returned: 0 in 0.372s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:57 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb is being set with open permissions: ugo+rw Aug 26 12:10:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:10:57 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb Aug 26 12:10:57 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:10:57 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Aug 26 12:10:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb" returned: 0 in 0.317s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:10:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:10:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c481df81-1583-485c-a737-fc5667b0f948 tempest-VolumesSnapshotListTestJSON-1092123505 None] Create snapshot completed successfully Aug 26 12:10:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-ed3b2c7d-6065-404a-a1cc-cec4759cfe72 req-d7e47461-ac71-44d0-a5e4-c54adf7e9530 tempest-TestInstancesWithCinderVolumes-295371566 None] Terminate volume connection completed successfully. Aug 26 12:10:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-ed3b2c7d-6065-404a-a1cc-cec4759cfe72 req-d7e47461-ac71-44d0-a5e4-c54adf7e9530 tempest-TestInstancesWithCinderVolumes-295371566 None] Deleting attachment 0d125d31-adfd-4cd3-a56b-222450d8e8b3. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "cinder-89d3c3f0-db13-4969-8e62-0a1a5f43381c-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-89d3c3f0-db13-4969-8e62-0a1a5f43381c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "cinder-quobyte-89d3c3f0-db13-4969-8e62-0a1a5f43381c" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-2c515e6e-de1e-4797-8955-df6f8e8395fb-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-quobyte-89d3c3f0-db13-4969-8e62-0a1a5f43381c" acquired by "delete_volume" :: waited 0.046s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-2c515e6e-de1e-4797-8955-df6f8e8395fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fee11a0-11dc-4110-8693-6d1cb23b7584]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-quobyte-2c515e6e-de1e-4797-8955-df6f8e8395fb" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-2c515e6e-de1e-4797-8955-df6f8e8395fb" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Deleting offline snapshot 2c515e6e-de1e-4797-8955-df6f8e8395fb of volume 747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] snapshot_file for this snap is: volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8daccc3-cf84-4dbb-b699-cc18ab326baf]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:00 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c Aug 26 12:11:00 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:00 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb Aug 26 12:11:00 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:00 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c" returned: 0 in 0.535s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:00 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c Aug 26 12:11:00 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:00 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb" returned: 0 in 0.551s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747d812b-f011-44de-99ee-4343b998e425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[547212ff-9e62-489c-bf45-700d0ed2d8db]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:01 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea Aug 26 12:11:01 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:01 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-89d3c3f0-db13-4969-8e62-0a1a5f43381c" returned: 0 in 0.340s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-quobyte-89d3c3f0-db13-4969-8e62-0a1a5f43381c" released by "delete_volume" :: held 0.962s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:01 devstack cinder-volume[94387]: WARNING cinder.quota [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1865112974-636231952 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1865112974-636231952, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:11:01 devstack cinder-volume[94387]: WARNING cinder.quota [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1865112974-636231952 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1865112974-636231952, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Created reservations ['c7bf28b2-30cb-4e9a-a5cf-a3c43f1ad9bc', '4f4ee90f-f7d9-455c-894e-dbc92e6f5bfe', '861ac1d8-80b6-4cfc-90b9-86e10432f485', '6d1ec21f-9d78-44bd-95f7-875425f5cc00'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:01 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:11:01 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:01 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea" returned: 0 in 0.482s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747d812b-f011-44de-99ee-4343b998e425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:01 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb Aug 26 12:11:01 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:01 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.328s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:11:01 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Deleted volume successfully. Aug 26 12:11:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0fae1a77-8b00-477d-be7a-8d6ad372b660 tempest-TestInstancesWithCinderVolumes-295371566 None] Lock "cinder-89d3c3f0-db13-4969-8e62-0a1a5f43381c-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:02 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb" returned: 0 in 0.635s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:02 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb Aug 26 12:11:02 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:02 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.2c515e6e-de1e-4797-8955-df6f8e8395fb" returned: 0 in 0.419s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-2c515e6e-de1e-4797-8955-df6f8e8395fb" released by "_delete_snapshot" :: held 2.253s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" released by "delete_snapshot" :: held 2.299s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:02 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Created reservations ['593d1272-1127-440e-87b0-f9681b2c699d', '62b9bd72-ba9b-428f-9f2c-c009609df937', '95c6a15d-384d-41b4-87c2-f6d0ee36c470', 'c25d4831-1be4-44bb-9db3-fe52c28e0581'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:11:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Delete snapshot completed successfully. Aug 26 12:11:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d0fb43a-b3d8-4149-8c8e-5e49b6b2d940 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-2c515e6e-de1e-4797-8955-df6f8e8395fb-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-4c717018-ecab-4a03-8fd1-7429972f6cea-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-4c717018-ecab-4a03-8fd1-7429972f6cea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-quobyte-4c717018-ecab-4a03-8fd1-7429972f6cea" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-4c717018-ecab-4a03-8fd1-7429972f6cea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Deleting offline snapshot 4c717018-ecab-4a03-8fd1-7429972f6cea of volume 747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] snapshot_file for this snap is: volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b25b9a-9071-41b5-82b8-b8d54319ffd4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:03 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea Aug 26 12:11:03 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:04 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea" returned: 0 in 0.522s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747d812b-f011-44de-99ee-4343b998e425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:11:04 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe144508-e670-481b-8375-bbad36bb08a3]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:04 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab Aug 26 12:11:04 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:04 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab" returned: 0 in 0.464s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747d812b-f011-44de-99ee-4343b998e425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:11:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:04 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea Aug 26 12:11:04 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:05 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea" returned: 0 in 0.637s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:05 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea Aug 26 12:11:05 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:05 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.4c717018-ecab-4a03-8fd1-7429972f6cea" returned: 0 in 0.395s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-4c717018-ecab-4a03-8fd1-7429972f6cea" released by "_delete_snapshot" :: held 2.164s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" released by "delete_snapshot" :: held 2.195s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:05 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Created reservations ['42a5e143-d9c5-434e-b727-d3ee4fd30064', '56587eb3-c5a7-4f5f-8631-d164b89d50aa', '6e3b4f16-30b7-4f0f-bea9-b479ac9edf53', '14b66191-51b0-4848-9c16-258c2464aa55'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:11:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Delete snapshot completed successfully. Aug 26 12:11:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ba2aca07-dc4a-4a59-96b4-945a2e25b595 tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-4c717018-ecab-4a03-8fd1-7429972f6cea-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-19b0f8b4-15e2-4c9a-abca-6e32b0127fab-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-19b0f8b4-15e2-4c9a-abca-6e32b0127fab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-quobyte-19b0f8b4-15e2-4c9a-abca-6e32b0127fab" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-19b0f8b4-15e2-4c9a-abca-6e32b0127fab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Deleting offline snapshot 19b0f8b4-15e2-4c9a-abca-6e32b0127fab of volume 747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] snapshot_file for this snap is: volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8fc9ec-0a3a-4974-bb93-feb31904b17d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:07 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab Aug 26 12:11:07 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:07 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab" returned: 0 in 0.384s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747d812b-f011-44de-99ee-4343b998e425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:11:07 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b3d686-267e-466f-97cc-d147a429c612]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:07 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 Aug 26 12:11:07 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:07 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425" returned: 0 in 0.473s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:07 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab Aug 26 12:11:07 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:08 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab" returned: 0 in 0.473s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:08 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab Aug 26 12:11:08 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:08 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425.19b0f8b4-15e2-4c9a-abca-6e32b0127fab" returned: 0 in 0.295s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:08 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:DELETE=8,cinder:SELECT=111,cinder:INSERT=21,cinder:UPDATE=104 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:11:08 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=111,cinder:SELECT=99,cinder:DELETE=9,cinder:INSERT=33 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:11:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-19b0f8b4-15e2-4c9a-abca-6e32b0127fab" released by "_delete_snapshot" :: held 1.782s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" released by "delete_snapshot" :: held 1.821s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:08 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Created reservations ['01a7ff30-8aa8-4815-81bd-9e2f90c7f4b8', 'da83a3d9-61ae-495a-8d3c-99d8a941b4fb', 'e725987e-9497-4f18-abfd-565b4e4fe70a', 'f51d2e2a-87f5-4a61-bf4c-d039e7fd1167'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:11:08 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Delete snapshot completed successfully. Aug 26 12:11:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5439a68d-7668-421c-875b-9d75ce8d23af tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-19b0f8b4-15e2-4c9a-abca-6e32b0127fab-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-747d812b-f011-44de-99ee-4343b998e425-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-747d812b-f011-44de-99ee-4343b998e425-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30ea85-336f-4dfc-8578-bc0f8fb51ab6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:09 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 Aug 26 12:11:09 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:09 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425" returned: 0 in 0.410s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:09 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425 Aug 26 12:11:09 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:10 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-747d812b-f011-44de-99ee-4343b998e425" returned: 0 in 0.300s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-quobyte-747d812b-f011-44de-99ee-4343b998e425" released by "delete_volume" :: held 0.797s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Created reservations ['109d3490-0470-4460-9f7c-e9ad8ee75435', 'dfebf906-d5c0-4bf2-bd80-1a9d2800b098', '8f06db6e-5809-4eb8-a3f5-96e1c18abb3c', '2a2c7e95-fc10-4996-998d-e42ab52072b0'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:10 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:11:10 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:10 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.295s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:11:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Deleted volume successfully. Aug 26 12:11:10 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:11:10 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-11446493-fee2-48d9-9695-d46546bc040f tempest-VolumesSnapshotListTestJSON-1092123505 None] Lock "cinder-747d812b-f011-44de-99ee-4343b998e425-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:10 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.314s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:11:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:11:20 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=9,cinder:INSERT=5,cinder:UPDATE=12 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:11:20 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Flow 'volume_create_manager' (f3a8fcd9-3e4c-4a5e-9f33-b65325cf54c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161ec9d7-485e-4a00-a6b6-eec408ebfbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161ec9d7-485e-4a00-a6b6-eec408ebfbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-44241694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c846c99-78bf-4e79-ace4-72fc9b8e3107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31a2ba0718948bea70d18482506b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:11:27Z,use_quota=True,user_id='36ed3a2e6ba846a3b84111f524a384cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d074f4-1487-4a78-a00f-f0ce6e5dfe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d074f4-1487-4a78-a00f-f0ce6e5dfe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cd28f4-3b4f-4d57-bd1c-a843cb0b417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cd28f4-3b4f-4d57-bd1c-a843cb0b417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c846c99-78bf-4e79-ace4-72fc9b8e3107', 'volume_name': 'volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c2a603-301f-4865-8b2b-80e35ec72c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c2a603-301f-4865-8b2b-80e35ec72c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13acb2e8-6051-49d4-b92b-9eac394bb625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:26 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Volume 4c846c99-78bf-4e79-ace4-72fc9b8e3107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107', 'volume_size': 1} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-44241694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c846c99-78bf-4e79-ace4-72fc9b8e3107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31a2ba0718948bea70d18482506b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:11:27Z,use_quota=True,user_id='36ed3a2e6ba846a3b84111f524a384cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Creating volume 4c846c99-78bf-4e79-ace4-72fc9b8e3107 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:11:26 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:11:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:26 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 1073741824 Aug 26 12:11:26 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Flow 'volume_create_manager' (83c7f73d-c968-4a4e-b595-e2ad1cb9e668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d444cb-c1b2-450a-bb9e-635dd3215aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d444cb-c1b2-450a-bb9e-635dd3215aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1320978590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5532d511-f1d7-42ff-9751-ce08e0c492f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31a2ba0718948bea70d18482506b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:11:27Z,use_quota=True,user_id='36ed3a2e6ba846a3b84111f524a384cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2570c471-382a-4057-b332-69bf292a77e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2570c471-382a-4057-b332-69bf292a77e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0d5019-8abe-41ab-89c5-3b05789996cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0d5019-8abe-41ab-89c5-3b05789996cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5532d511-f1d7-42ff-9751-ce08e0c492f2', 'volume_name': 'volume-5532d511-f1d7-42ff-9751-ce08e0c492f2', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487d0c91-f610-4820-a272-37e616216c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487d0c91-f610-4820-a272-37e616216c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7151fa9-6fba-4aa2-b493-ad8ea30e18de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:27 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Volume 5532d511-f1d7-42ff-9751-ce08e0c492f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5532d511-f1d7-42ff-9751-ce08e0c492f2', 'volume_size': 1} Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:27 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 1073741824" returned: 0 in 1.118s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:28 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 Aug 26 12:11:28 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:28 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107" returned: 0 in 0.547s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1320978590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5532d511-f1d7-42ff-9751-ce08e0c492f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31a2ba0718948bea70d18482506b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:11:27Z,use_quota=True,user_id='36ed3a2e6ba846a3b84111f524a384cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Creating volume 5532d511-f1d7-42ff-9751-ce08e0c492f2 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:11:28 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13acb2e8-6051-49d4-b92b-9eac394bb625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab3323d-e5be-4479-a1e5-5985fcfe490b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:28 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 1073741824 Aug 26 12:11:28 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:28 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Volume volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 (4c846c99-78bf-4e79-ace4-72fc9b8e3107): created successfully Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab3323d-e5be-4479-a1e5-5985fcfe490b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Flow 'volume_create_manager' (f3a8fcd9-3e4c-4a5e-9f33-b65325cf54c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:11:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-99d2a444-ba7f-414b-9b4f-a1871012b0bf tempest-TestServerVolumeAttachmentScenario-759760161 None] Created volume successfully. Aug 26 12:11:29 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 1073741824" returned: 0 in 0.866s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:29 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 Aug 26 12:11:29 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:30 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2" returned: 0 in 0.463s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:11:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7151fa9-6fba-4aa2-b493-ad8ea30e18de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5532d511-f1d7-42ff-9751-ce08e0c492f2', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b62568e-11c1-4fae-822c-e9f6e5f8942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:30 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Volume volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 (5532d511-f1d7-42ff-9751-ce08e0c492f2): created successfully Aug 26 12:11:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b62568e-11c1-4fae-822c-e9f6e5f8942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Flow 'volume_create_manager' (83c7f73d-c968-4a4e-b595-e2ad1cb9e668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:11:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-511d3ed6-cb99-4e96-9cf2-d6e7be1ab65d tempest-TestServerVolumeAttachmentScenario-759760161 None] Created volume successfully. Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Flow 'volume_create_manager' (bf641df7-fd82-408b-9dcb-2c4be007b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45352ce3-1216-457a-8505-45b49387d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45352ce3-1216-457a-8505-45b49387d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9058cb-d679-4b42-8c67-3bc7a6e4dac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07944011b75e4f9e9a9cb096501fae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:11:35Z,use_quota=True,user_id='6cf4cee7bb494b758b94304cb70b5f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab5c751-97e3-4ff3-96ba-0ab9af601c40),volume_type_id=aab5c751-97e3-4ff3-96ba-0ab9af601c40)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c79d5b3-ac4d-48ee-b870-2ab59ab75ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c79d5b3-ac4d-48ee-b870-2ab59ab75ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f2c033-dc27-4b5e-965f-19619c4f669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f2c033-dc27-4b5e-965f-19619c4f669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a9058cb-d679-4b42-8c67-3bc7a6e4dac3', 'volume_name': 'volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3', 'volume_size': 1, 'image_id': '58a69621-b4c4-4cc1-8709-5ba1284a7563', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58a69621-b4c4-4cc1-8709-5ba1284a7563', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9acf1a3b2987f45c8f6b4f4d6e757b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07944011b75e4f9e9a9cb096501fae82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5f5a17158ba6fb026bc0b1011acfed663450df68f5e596bb077ef6d3cde02020084f07dac9f107a060513ea8bf951387eb4e47c03e9801a9e8fb51d32c0d5fe', 'id': '58a69621-b4c4-4cc1-8709-5ba1284a7563', 'created_at': datetime.datetime(2026, 8, 26, 10, 11, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 11, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58a69621-b4c4-4cc1-8709-5ba1284a7563/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3706a3-aa90-46c7-8fe0-13a1ae8ac1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3706a3-aa90-46c7-8fe0-13a1ae8ac1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78584228-46fe-4279-9ebb-c2d55eee3fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:35 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Volume 4a9058cb-d679-4b42-8c67-3bc7a6e4dac3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3', 'volume_size': 1, 'image_id': '58a69621-b4c4-4cc1-8709-5ba1284a7563', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58a69621-b4c4-4cc1-8709-5ba1284a7563', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9acf1a3b2987f45c8f6b4f4d6e757b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07944011b75e4f9e9a9cb096501fae82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5f5a17158ba6fb026bc0b1011acfed663450df68f5e596bb077ef6d3cde02020084f07dac9f107a060513ea8bf951387eb4e47c03e9801a9e8fb51d32c0d5fe', 'id': '58a69621-b4c4-4cc1-8709-5ba1284a7563', 'created_at': datetime.datetime(2026, 8, 26, 10, 11, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 11, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58a69621-b4c4-4cc1-8709-5ba1284a7563/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 12:11:35 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Trying to clone 4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 from image 58a69621-b4c4-4cc1-8709-5ba1284a7563 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58a69621-b4c4-4cc1-8709-5ba1284a7563', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:11:36 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:11:36 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Image download 0.00 MB at 0.00 MB/s Aug 26 12:11:36 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7131cb2-9be4-49b1-bfa2-299a42c85e25]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:36 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD Aug 26 12:11:36 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:36 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:36 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD Aug 26 12:11:36 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:36 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:11:37 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Temporary image 58a69621-b4c4-4cc1-8709-5ba1284a7563 is fetched for user 6cf4cee7bb494b758b94304cb70b5f1a. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:11:37 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1510160f-c498-4b81-b1ac-8aa05f422edd]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:37 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD Aug 26 12:11:37 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:37 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:37 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD Aug 26 12:11:37 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:38 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD" returned: 1 in 0.689s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9058cb-d679-4b42-8c67-3bc7a6e4dac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07944011b75e4f9e9a9cb096501fae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:11:35Z,use_quota=True,user_id='6cf4cee7bb494b758b94304cb70b5f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab5c751-97e3-4ff3-96ba-0ab9af601c40),volume_type_id=aab5c751-97e3-4ff3-96ba-0ab9af601c40)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Creating volume 4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:11:38 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:11:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:38 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 1073741824 Aug 26 12:11:38 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:39 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 1073741824" returned: 0 in 0.906s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:39 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 Aug 26 12:11:39 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:39 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3" returned: 0 in 0.367s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:11:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:39 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Attempting download of 58a69621-b4c4-4cc1-8709-5ba1284a7563 ((None, [{'url': 'file:///opt/stack/data/glance/images/58a69621-b4c4-4cc1-8709-5ba1284a7563', 'metadata': {}}])) to volume 4a9058cb-d679-4b42-8c67-3bc7a6e4dac3. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:11:39 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[531a1c46-d65d-45f4-988b-599ee7bf59fd]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58a69621-b4c4-4cc1-8709-5ba1284a7563_hjc88s2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:39 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58a69621-b4c4-4cc1-8709-5ba1284a7563_hjc88s2e Aug 26 12:11:39 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:40 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58a69621-b4c4-4cc1-8709-5ba1284a7563_hjc88s2e" returned: 0 in 0.425s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58a69621-b4c4-4cc1-8709-5ba1284a7563_hjc88s2e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:40 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58a69621-b4c4-4cc1-8709-5ba1284a7563_hjc88s2e Aug 26 12:11:40 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:40 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58a69621-b4c4-4cc1-8709-5ba1284a7563_hjc88s2e" returned: 1 in 0.380s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58a69621-b4c4-4cc1-8709-5ba1284a7563_hjc88s2e' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:11:40 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7240a5-149b-483a-9106-8765cc505152]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:40 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD Aug 26 12:11:40 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:40 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:41 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD Aug 26 12:11:41 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:41 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:11:41 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] 58a69621-b4c4-4cc1-8709-5ba1284a7563 was raw, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:11:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:41 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 Aug 26 12:11:41 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:42 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3" returned: 0 in 0.851s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:42 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58a69621-b4c4-4cc1-8709-5ba1284a7563_43vex9trdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:11:42 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 12:11:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:42 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 1G Aug 26 12:11:42 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:42 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 1G" returned: 0 in 0.539s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:42 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Downloaded image 58a69621-b4c4-4cc1-8709-5ba1284a7563 ((None, [{'url': 'file:///opt/stack/data/glance/images/58a69621-b4c4-4cc1-8709-5ba1284a7563', 'metadata': {}}])) to volume 4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:11:42 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Temporary image 58a69621-b4c4-4cc1-8709-5ba1284a7563 for user 6cf4cee7bb494b758b94304cb70b5f1a is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:11:42 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Marking volume 4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:11:42 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Copying metadata from image 58a69621-b4c4-4cc1-8709-5ba1284a7563 to 4a9058cb-d679-4b42-8c67-3bc7a6e4dac3. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:11:42 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Creating volume glance metadata for volume 4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 backed by image 58a69621-b4c4-4cc1-8709-5ba1284a7563 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '58a69621-b4c4-4cc1-8709-5ba1284a7563', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c9acf1a3b2987f45c8f6b4f4d6e757b5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:11:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78584228-46fe-4279-9ebb-c2d55eee3fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3', 'volume_size': 1, 'image_id': '58a69621-b4c4-4cc1-8709-5ba1284a7563', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58a69621-b4c4-4cc1-8709-5ba1284a7563', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9acf1a3b2987f45c8f6b4f4d6e757b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07944011b75e4f9e9a9cb096501fae82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5f5a17158ba6fb026bc0b1011acfed663450df68f5e596bb077ef6d3cde02020084f07dac9f107a060513ea8bf951387eb4e47c03e9801a9e8fb51d32c0d5fe', 'id': '58a69621-b4c4-4cc1-8709-5ba1284a7563', 'created_at': datetime.datetime(2026, 8, 26, 10, 11, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 11, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58a69621-b4c4-4cc1-8709-5ba1284a7563/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a66df7-c0f8-474c-ba02-d56d87b4855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Volume volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 (4a9058cb-d679-4b42-8c67-3bc7a6e4dac3): created successfully Aug 26 12:11:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a66df7-c0f8-474c-ba02-d56d87b4855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Flow 'volume_create_manager' (bf641df7-fd82-408b-9dcb-2c4be007b695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:11:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b9bb0261-4300-4b09-bef2-780a625b2dbe tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Created volume successfully. Aug 26 12:11:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Acquiring lock "cinder-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "cinder-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Acquiring lock "cinder-quobyte-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "cinder-quobyte-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e35273a-c113-4ddb-9af3-44af8c005617]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:44 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 Aug 26 12:11:44 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:44 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3" returned: 0 in 0.544s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:45 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3 Aug 26 12:11:45 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:45 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3" returned: 0 in 0.447s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "cinder-quobyte-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3" released by "delete_volume" :: held 1.058s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:45 devstack cinder-volume[94387]: WARNING cinder.quota [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:11:45 devstack cinder-volume[94387]: WARNING cinder.quota [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 12:11:45 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Created reservations ['ce7493e0-640d-4e0a-92b8-383a1f2c9ed6', '700026fd-b43d-4e8a-a339-e583a1b5d6f0', '5a8c802f-3237-4d9a-a365-ae5f0370e970', 'c7cd17cc-0446-4535-aeb2-a593c2cae2be'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:11:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:11:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:11:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:45 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:11:45 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:46 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.599s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:46 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:11:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Deleted volume successfully. Aug 26 12:11:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5f87f447-1566-470c-a35d-1ccc04eb5210 tempest-VolumeAndVolumeTypeFromImageTest-560140875 None] Lock "cinder-4a9058cb-d679-4b42-8c67-3bc7a6e4dac3-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-a0b421dc-9e67-4f6e-bc37-3e3601b86798 req-754eb615-555f-410e-89e7-f3c99cd08f42 tempest-TestMinimumBasicScenario-1515078605 None] Terminate volume connection completed successfully. Aug 26 12:11:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a0b421dc-9e67-4f6e-bc37-3e3601b86798 req-754eb615-555f-410e-89e7-f3c99cd08f42 tempest-TestMinimumBasicScenario-1515078605 None] Deleting attachment adc0d2c8-ad89-49f3-92fe-024b3817abca. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:11:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Acquiring lock "cinder-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Lock "cinder-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Acquiring lock "cinder-quobyte-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:11:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Lock "cinder-quobyte-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:11:51 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54028d9-6a95-4616-b4be-82d4fe8818bc]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:51 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 Aug 26 12:11:51 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:51 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7" returned: 0 in 0.664s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:51 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7 Aug 26 12:11:51 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:52 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7" returned: 0 in 0.427s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Lock "cinder-quobyte-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7" released by "delete_volume" :: held 1.163s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Created reservations ['2ad7eb7d-1a23-4165-a80f-21e7b9ee8146', '68225efb-05b2-404b-a475-6c52af4e388f', 'c3cf45e8-9103-4410-b186-607610ccf024', '9480d2d7-d8a8-4e8f-9f9a-bd6178f52c8c'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:52 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:11:52 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:52 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.414s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:11:52 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Deleted volume successfully. Aug 26 12:11:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-0f207ed5-f264-4a83-a54e-39a0d750e9e1 tempest-TestMinimumBasicScenario-1515078605 None] Lock "cinder-ceb9b495-d0b4-4c75-ba27-5b5645ed01a7-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (633383ca-c5b4-4371-a979-7eb4907e7d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888eb240-4b29-4182-9c31-c9c841d651ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888eb240-4b29-4182-9c31-c9c841d651ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1403017120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d5c45d-8d58-4f36-86e7-106f7749cea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:11:55Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7795bb76-9943-4416-a46a-c1c9e258d4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7795bb76-9943-4416-a46a-c1c9e258d4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bea0d4-74c9-4d8e-8932-a43f7bf6583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bea0d4-74c9-4d8e-8932-a43f7bf6583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d5c45d-8d58-4f36-86e7-106f7749cea9', 'volume_name': 'volume-40d5c45d-8d58-4f36-86e7-106f7749cea9', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdbfaac-5b70-4273-afa5-17ba54882972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdbfaac-5b70-4273-afa5-17ba54882972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf7c1dc-b252-4fe2-bf36-d14349c2a351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:55 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume 40d5c45d-8d58-4f36-86e7-106f7749cea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d5c45d-8d58-4f36-86e7-106f7749cea9', 'volume_size': 1} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1403017120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d5c45d-8d58-4f36-86e7-106f7749cea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:11:55Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Creating volume 40d5c45d-8d58-4f36-86e7-106f7749cea9 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:11:55 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:11:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:55 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 1073741824 Aug 26 12:11:55 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:56 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 1073741824" returned: 0 in 0.638s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:56 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 Aug 26 12:11:56 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:56 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9" returned: 0 in 0.365s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:11:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:11:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf7c1dc-b252-4fe2-bf36-d14349c2a351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d5c45d-8d58-4f36-86e7-106f7749cea9', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd5eda3-0ba0-4886-87d4-d516496c93a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:11:56 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 (40d5c45d-8d58-4f36-86e7-106f7749cea9): created successfully Aug 26 12:11:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd5eda3-0ba0-4886-87d4-d516496c93a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:11:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (633383ca-c5b4-4371-a979-7eb4907e7d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:11:56 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5788a246-3e16-4bf7-bdc0-697d1ea05be8 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created volume successfully. Aug 26 12:11:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:11:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:11:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Creating offline snapshot 80b7dd9c-02aa-466c-8486-cacc3b576c97 of volume 40d5c45d-8d58-4f36-86e7-106f7749cea9 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:11:57 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8072c2-12fc-4be1-8c20-47e0b9c1ec42]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:11:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:58 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 Aug 26 12:11:58 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:58 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9" returned: 0 in 0.408s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:58 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 1G Aug 26 12:11:58 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:58 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 1G" returned: 0 in 0.538s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:58 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 Aug 26 12:11:58 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:59 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97" returned: 0 in 0.498s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:59 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 is being set with open permissions: ugo+rw Aug 26 12:11:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:59 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 Aug 26 12:11:59 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:11:59 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Aug 26 12:11:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97" returned: 0 in 0.405s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:11:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:11:59 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.info Aug 26 12:11:59 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:00 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.info" returned: 0 in 0.389s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:00 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.info is being set with open permissions: ugo+rw Aug 26 12:12:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:00 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.info Aug 26 12:12:00 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:00 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.info" returned: 0 in 0.329s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.666s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fce5a973-c956-4d9c-b6b8-cb45f5433621 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Create snapshot completed successfully Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (bb417c21-c09e-4a63-bbbe-2f544cd8ee84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fd6b6e-ad77-4a13-9da7-84125ccac0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fd6b6e-ad77-4a13-9da7-84125ccac0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285690822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a77ad9-a6a7-4dbb-b624-5e0ed18cefae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:02Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6cde24-e7dd-43d3-9778-c7bb5bc5e80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6cde24-e7dd-43d3-9778-c7bb5bc5e80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e48024-92f2-4d72-bbd2-1e1a995dc773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e48024-92f2-4d72-bbd2-1e1a995dc773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a77ad9-a6a7-4dbb-b624-5e0ed18cefae', 'volume_name': 'volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc2f3d4-02df-43da-8c13-df29df796ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc2f3d4-02df-43da-8c13-df29df796ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36ba3fd-5113-408e-8b2f-101dce12e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:01 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume 96a77ad9-a6a7-4dbb-b624-5e0ed18cefae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae', 'volume_size': 1} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285690822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a77ad9-a6a7-4dbb-b624-5e0ed18cefae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:02Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Creating volume 96a77ad9-a6a7-4dbb-b624-5e0ed18cefae {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:12:01 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:12:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:01 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae 1073741824 Aug 26 12:12:01 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (cea48a44-5951-47c6-9eae-fdc874cd1795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510ff2b1-45e5-4119-8171-aff8929c6be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510ff2b1-45e5-4119-8171-aff8929c6be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973412996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effcbcd4-bae7-42d9-b001-2a8b7c926f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:02Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c25602-8d3c-4252-a30d-fbb5f9aabf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c25602-8d3c-4252-a30d-fbb5f9aabf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2851e27-2beb-4d91-a884-4d8be992e4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2851e27-2beb-4d91-a884-4d8be992e4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'effcbcd4-bae7-42d9-b001-2a8b7c926f1e', 'volume_name': 'volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f57722-7ddd-4ef1-84b1-1501d8679d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:02 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f57722-7ddd-4ef1-84b1-1501d8679d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45525007-34d8-4e1b-89f9-1657162f660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:02 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume effcbcd4-bae7-42d9-b001-2a8b7c926f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e', 'volume_size': 1} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae 1073741824" returned: 0 in 1.200s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:03 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae Aug 26 12:12:03 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:03 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae" returned: 0 in 0.406s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973412996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effcbcd4-bae7-42d9-b001-2a8b7c926f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:02Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Creating volume effcbcd4-bae7-42d9-b001-2a8b7c926f1e {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:12:03 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36ba3fd-5113-408e-8b2f-101dce12e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:03 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e 1073741824 Aug 26 12:12:03 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ac3bde-aa1c-4bd2-8db8-05a62beab646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:03 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae (96a77ad9-a6a7-4dbb-b624-5e0ed18cefae): created successfully Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ac3bde-aa1c-4bd2-8db8-05a62beab646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (bb417c21-c09e-4a63-bbbe-2f544cd8ee84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:03 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f83b4802-7156-450b-9ac8-89f627598310 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created volume successfully. Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (4709db57-58e6-494d-bba0-8726561ab3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875835ab-726c-47a5-81bc-2afdc16a9c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875835ab-726c-47a5-81bc-2afdc16a9c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065913604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190a07fd-ad9f-43da-8bfb-54b54f50d8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:04Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0868238a-0c9a-47fd-9bc9-ce8d7025f339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0868238a-0c9a-47fd-9bc9-ce8d7025f339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69f161f-753c-4f69-acf4-8e5fe8283a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69f161f-753c-4f69-acf4-8e5fe8283a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190a07fd-ad9f-43da-8bfb-54b54f50d8bc', 'volume_name': 'volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13167a5e-abf5-438d-a674-468ea25d492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13167a5e-abf5-438d-a674-468ea25d492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8e0b76-7172-4f21-a708-bbd21587b2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume 190a07fd-ad9f-43da-8bfb-54b54f50d8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc', 'volume_size': 1} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:04 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e 1073741824" returned: 0 in 0.946s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:04 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e Aug 26 12:12:04 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (0f4ef72a-d917-4194-8406-7e832ea444c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbf92e3-7244-4741-bd93-2f96faae552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbf92e3-7244-4741-bd93-2f96faae552d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773501374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:05Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca3d497-8545-44f7-b669-660bedb41abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca3d497-8545-44f7-b669-660bedb41abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da3b83b-763e-450d-8ade-325d93af02b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da3b83b-763e-450d-8ade-325d93af02b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd', 'volume_name': 'volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5ba108-db11-4792-a19c-0551c89eb094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5ba108-db11-4792-a19c-0551c89eb094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b915cf-3bc3-4434-9dee-76631bef85be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:04 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd', 'volume_size': 1} Aug 26 12:12:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:05 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e" returned: 0 in 0.633s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.913s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065913604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190a07fd-ad9f-43da-8bfb-54b54f50d8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:04Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Creating volume 190a07fd-ad9f-43da-8bfb-54b54f50d8bc {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:12:05 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:05 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc 1073741824 Aug 26 12:12:05 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45525007-34d8-4e1b-89f9-1657162f660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4497a70c-ddd7-453c-8ed3-2fb1d7b18bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:05 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e (effcbcd4-bae7-42d9-b001-2a8b7c926f1e): created successfully Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4497a70c-ddd7-453c-8ed3-2fb1d7b18bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (cea48a44-5951-47c6-9eae-fdc874cd1795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0fb8fc1d-19c7-4d8e-88ec-db4dd6452088 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created volume successfully. Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (56c63d93-ff9a-44f6-b2e9-01e733e64ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3768960-9207-40dd-ab30-c33ebf5aed2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3768960-9207-40dd-ab30-c33ebf5aed2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772627250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcaabae2-da1d-4a71-8647-a9184a5312b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:05Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b0859c-3be1-477e-854c-18a8547bfad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b0859c-3be1-477e-854c-18a8547bfad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70ec4b7-4fe0-4d00-8f0e-51153c840d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70ec4b7-4fe0-4d00-8f0e-51153c840d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcaabae2-da1d-4a71-8647-a9184a5312b2', 'volume_name': 'volume-bcaabae2-da1d-4a71-8647-a9184a5312b2', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57556153-394a-4ec5-85f5-aae815e0990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57556153-394a-4ec5-85f5-aae815e0990c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569f678d-a3cb-49c8-9f93-ed57d34a0519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:05 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume bcaabae2-da1d-4a71-8647-a9184a5312b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcaabae2-da1d-4a71-8647-a9184a5312b2', 'volume_size': 1} Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:05 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc 1073741824" returned: 0 in 0.751s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:06 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc Aug 26 12:12:06 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:06 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc" returned: 0 in 0.382s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773501374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:05Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Creating volume da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:12:06 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:06 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd 1073741824 Aug 26 12:12:06 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8e0b76-7172-4f21-a708-bbd21587b2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9421603-e79f-4db9-adac-37a7796bfdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:06 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc (190a07fd-ad9f-43da-8bfb-54b54f50d8bc): created successfully Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9421603-e79f-4db9-adac-37a7796bfdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (4709db57-58e6-494d-bba0-8726561ab3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:06 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8f06d447-3846-41dc-af54-b89d5b4de71a tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created volume successfully. Aug 26 12:12:07 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd 1073741824" returned: 0 in 0.682s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:07 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd Aug 26 12:12:07 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:07 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd" returned: 0 in 0.375s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772627250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcaabae2-da1d-4a71-8647-a9184a5312b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46fc00071e487ab8be633c043906d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:05Z,use_quota=True,user_id='b0c4ace3709f41e691d2c3071a71cfce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Creating volume bcaabae2-da1d-4a71-8647-a9184a5312b2 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:12:07 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b915cf-3bc3-4434-9dee-76631bef85be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3efb54-b2b0-4783-86a1-0a9cdb69327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:07 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 1073741824 Aug 26 12:12:07 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:07 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd (da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd): created successfully Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3efb54-b2b0-4783-86a1-0a9cdb69327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (0f4ef72a-d917-4194-8406-7e832ea444c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:07 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7e7039d8-df13-4de9-a79b-7aab1a0188b5 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created volume successfully. Aug 26 12:12:08 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 1073741824" returned: 0 in 0.673s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:08 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 Aug 26 12:12:08 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-69531680-7c12-40a9-87d8-45b603a31854 req-99cacd0e-1e7a-4340-ac6e-52f3cda9aacf tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:08 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2" returned: 0 in 0.292s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-69531680-7c12-40a9-87d8-45b603a31854 req-99cacd0e-1e7a-4340-ac6e-52f3cda9aacf tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.096s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569f678d-a3cb-49c8-9f93-ed57d34a0519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcaabae2-da1d-4a71-8647-a9184a5312b2', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b95fcdd-9afb-4126-b267-cee2d65933e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-69531680-7c12-40a9-87d8-45b603a31854 req-99cacd0e-1e7a-4340-ac6e-52f3cda9aacf tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:08 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Volume volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 (bcaabae2-da1d-4a71-8647-a9184a5312b2): created successfully Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b95fcdd-9afb-4126-b267-cee2d65933e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Flow 'volume_create_manager' (56c63d93-ff9a-44f6-b2e9-01e733e64ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:08 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6f985995-91bb-4c70-abd6-e8cbd8af8278 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created volume successfully. Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-69531680-7c12-40a9-87d8-45b603a31854 req-99cacd0e-1e7a-4340-ac6e-52f3cda9aacf tempest-TestServerVolumeAttachmentScenario-759760161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '735156b9-80d3-4ea0-b1e1-376c9cb4451f', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-bcaabae2-da1d-4a71-8647-a9184a5312b2-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:08 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-69531680-7c12-40a9-87d8-45b603a31854 req-99cacd0e-1e7a-4340-ac6e-52f3cda9aacf tempest-TestServerVolumeAttachmentScenario-759760161 None] attachment_update completed successfully. Aug 26 12:12:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-bcaabae2-da1d-4a71-8647-a9184a5312b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-quobyte-bcaabae2-da1d-4a71-8647-a9184a5312b2" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-bcaabae2-da1d-4a71-8647-a9184a5312b2" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[827ad759-d895-491d-8afb-fe30f367170d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:09 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 Aug 26 12:12:09 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:09 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2" returned: 0 in 0.576s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:09 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2 Aug 26 12:12:09 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:09 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bcaabae2-da1d-4a71-8647-a9184a5312b2" returned: 0 in 0.301s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-bcaabae2-da1d-4a71-8647-a9184a5312b2" released by "delete_volume" :: held 0.944s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created reservations ['4e440df5-65af-4be6-8f07-3fc5db8b4ca1', '2acab17a-74b4-457e-9793-d08abb0bc0d9', '43d4f3f7-7cc6-46b5-841f-b52e1a9a097d', '7df59ab2-aeab-425f-be67-92d9954f1ab3'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:10 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:10 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:10 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Deleted volume successfully. Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3edf88a7-f846-409b-bfdf-1e3c1173bb2c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-bcaabae2-da1d-4a71-8647-a9184a5312b2-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:10 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:10 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:10 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.397s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:12:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:12:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-quobyte-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:11 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b7390e-56d1-418e-8874-b82937f64d26]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:11 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd Aug 26 12:12:11 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:11 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd" returned: 0 in 0.467s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:11 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd Aug 26 12:12:11 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:12 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd" returned: 0 in 0.264s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd" released by "delete_volume" :: held 0.781s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created reservations ['273b5901-c236-48dd-9b91-70f14604979e', 'ef963ffb-c0e6-4359-9a44-9dd73f43ae25', '347c73eb-36a9-4bbc-9125-b142071303ba', 'ac0bd090-1507-4f9a-ace6-59999805b4ac'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:12 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:12 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-190a07fd-ad9f-43da-8bfb-54b54f50d8bc-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:12 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.410s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-190a07fd-ad9f-43da-8bfb-54b54f50d8bc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:12 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Deleted volume successfully. Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d7b2196e-428b-4e17-8984-71ff77274464 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-da8103c5-0a09-4a6c-9bf2-1112d8fcbfbd-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-quobyte-190a07fd-ad9f-43da-8bfb-54b54f50d8bc" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-190a07fd-ad9f-43da-8bfb-54b54f50d8bc" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d12fa-ef68-4e27-93ad-de8b140d7846]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:13 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc Aug 26 12:12:13 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:13 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc" returned: 0 in 0.537s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:13 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc Aug 26 12:12:13 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:13 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-190a07fd-ad9f-43da-8bfb-54b54f50d8bc" returned: 0 in 0.351s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-190a07fd-ad9f-43da-8bfb-54b54f50d8bc" released by "delete_volume" :: held 0.946s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created reservations ['4dd15821-1d13-4d97-850b-844c3b4f0c69', '85cf6157-fc4a-479e-88bd-0e5c502bc98a', 'c2896a41-58fb-4c84-8520-f8d23fe5f501', '98404f2f-d7df-4200-a7e0-3b0dd9bd8b78'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:14 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:14 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:14 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.352s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:14 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Deleted volume successfully. Aug 26 12:12:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f6842450-c875-4069-ab9b-cdb544d0104c tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-190a07fd-ad9f-43da-8bfb-54b54f50d8bc-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-effcbcd4-bae7-42d9-b001-2a8b7c926f1e-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-effcbcd4-bae7-42d9-b001-2a8b7c926f1e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-quobyte-effcbcd4-bae7-42d9-b001-2a8b7c926f1e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-effcbcd4-bae7-42d9-b001-2a8b7c926f1e" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0ad056-18fd-4c1f-8a1f-6d8d1e3bb829]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:15 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e Aug 26 12:12:15 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:15 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e" returned: 0 in 0.490s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:15 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e Aug 26 12:12:15 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-5102bd96-706a-43bb-ba46-b9926e6a3b1d req-2276a7cd-a956-48de-8466-5a618754da3e tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-5102bd96-706a-43bb-ba46-b9926e6a3b1d req-2276a7cd-a956-48de-8466-5a618754da3e tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-5102bd96-706a-43bb-ba46-b9926e6a3b1d req-2276a7cd-a956-48de-8466-5a618754da3e tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-5102bd96-706a-43bb-ba46-b9926e6a3b1d req-2276a7cd-a956-48de-8466-5a618754da3e tempest-TestServerVolumeAttachmentScenario-759760161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-5532d511-f1d7-42ff-9751-ce08e0c492f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e9621a2-7f53-483d-b04f-be5e56fa8124', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:12:15 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-effcbcd4-bae7-42d9-b001-2a8b7c926f1e" returned: 0 in 0.278s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-effcbcd4-bae7-42d9-b001-2a8b7c926f1e" released by "delete_volume" :: held 0.850s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-5102bd96-706a-43bb-ba46-b9926e6a3b1d req-2276a7cd-a956-48de-8466-5a618754da3e tempest-TestServerVolumeAttachmentScenario-759760161 None] attachment_update completed successfully. Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created reservations ['30ca816e-5e29-4aac-8e37-0c6e2c06a25c', '4fc6a177-bed5-4aa5-91f5-78173707c62c', 'd063606e-02de-4377-a578-b15d8dc489a0', '8ed4805c-f167-4ecb-aab4-5a3e6837e5f7'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:16 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:16 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-quobyte-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6c62ab-2ae2-40c7-8488-3936cfec565c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:16 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.328s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Deleted volume successfully. Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-153ae77f-ba28-4592-b6d4-b68a1783b8f6 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-effcbcd4-bae7-42d9-b001-2a8b7c926f1e-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:16 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae Aug 26 12:12:16 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:16 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae" returned: 0 in 0.481s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:17 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae Aug 26 12:12:17 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:17 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae" returned: 0 in 0.284s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae" released by "delete_volume" :: held 0.813s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created reservations ['cc7fa85e-577d-4406-a43a-fd4b7b6b10b5', 'ffd1ec18-d347-4d69-9bc6-4b50cd9e6af6', 'cd91bc7d-3be9-42a5-b12c-4f8af1e4d2ce', '0c1838be-2e09-4e61-a548-d1efaa830463'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:17 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:17 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-80b7dd9c-02aa-466c-8486-cacc3b576c97-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-80b7dd9c-02aa-466c-8486-cacc3b576c97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-quobyte-40d5c45d-8d58-4f36-86e7-106f7749cea9" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-40d5c45d-8d58-4f36-86e7-106f7749cea9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-quobyte-80b7dd9c-02aa-466c-8486-cacc3b576c97" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-80b7dd9c-02aa-466c-8486-cacc3b576c97" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Deleting offline snapshot 80b7dd9c-02aa-466c-8486-cacc3b576c97 of volume 40d5c45d-8d58-4f36-86e7-106f7749cea9 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] snapshot_file for this snap is: volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaef02d-d768-41e3-856d-eab31d9f2be4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:17 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.316s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:17 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Deleted volume successfully. Aug 26 12:12:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5102cfed-f884-4f5b-9218-483ed7b2628e tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-96a77ad9-a6a7-4dbb-b624-5e0ed18cefae-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:17 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 Aug 26 12:12:17 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:18 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97" returned: 0 in 0.418s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40d5c45d-8d58-4f36-86e7-106f7749cea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:12:18 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[48892c5f-35d2-4c52-8776-08bcdc287d4f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:18 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 Aug 26 12:12:18 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:18 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9" returned: 0 in 0.466s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:18 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 Aug 26 12:12:18 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:18 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-f4da1e57-f21a-4d11-9b7e-95fd15b50695 req-d4186c18-db5f-44b8-ad84-1ce0c76df2bd tempest-TestServerVolumeAttachmentScenario-759760161 None] Terminate volume connection completed successfully. Aug 26 12:12:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-f4da1e57-f21a-4d11-9b7e-95fd15b50695 req-d4186c18-db5f-44b8-ad84-1ce0c76df2bd tempest-TestServerVolumeAttachmentScenario-759760161 None] Deleting attachment 7e9621a2-7f53-483d-b04f-be5e56fa8124. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:12:18 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97" returned: 0 in 0.418s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:19 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97 Aug 26 12:12:19 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:19 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9.80b7dd9c-02aa-466c-8486-cacc3b576c97" returned: 0 in 0.259s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-80b7dd9c-02aa-466c-8486-cacc3b576c97" released by "_delete_snapshot" :: held 1.684s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-40d5c45d-8d58-4f36-86e7-106f7749cea9" released by "delete_snapshot" :: held 1.718s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created reservations ['4e7086cd-e8f7-4b9e-8b36-330fac0448b6', 'd785f353-81be-495c-8e1c-aa586e059fc2', '417e652d-f585-46b3-a7a6-55d4bb5eb04b', 'a1dc6903-1d5c-46b1-9b7e-27fa393ff88e'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:19 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Delete snapshot completed successfully. Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a605a3f0-6682-4002-92b1-ea4d52eb7a71 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-80b7dd9c-02aa-466c-8486-cacc3b576c97-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-40d5c45d-8d58-4f36-86e7-106f7749cea9-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-40d5c45d-8d58-4f36-86e7-106f7749cea9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "cinder-quobyte-40d5c45d-8d58-4f36-86e7-106f7749cea9" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-40d5c45d-8d58-4f36-86e7-106f7749cea9" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bfd1d2-05e4-43cb-9067-7f24faeed863]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:20 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 Aug 26 12:12:20 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:20 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9" returned: 0 in 0.410s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:20 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9 Aug 26 12:12:20 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=78,cinder:UPDATE=101,cinder:INSERT=25,cinder:DELETE=14 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:12:20 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-5e377aee-76f3-4a80-b8b8-763c97bfc03f req-ee90aab4-c251-4cd8-94a2-154715e26695 tempest-TestServerVolumeAttachmentScenario-759760161 None] Terminate volume connection completed successfully. Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-5e377aee-76f3-4a80-b8b8-763c97bfc03f req-ee90aab4-c251-4cd8-94a2-154715e26695 tempest-TestServerVolumeAttachmentScenario-759760161 None] Deleting attachment 735156b9-80d3-4ea0-b1e1-376c9cb4451f. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:12:20 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-40d5c45d-8d58-4f36-86e7-106f7749cea9" returned: 0 in 0.326s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-quobyte-40d5c45d-8d58-4f36-86e7-106f7749cea9" released by "delete_volume" :: held 0.831s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=90,cinder:SELECT=94,cinder:INSERT=27,cinder:DELETE=3 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Created reservations ['677d7d4d-bf6f-492c-a8b7-8a1ae6fa0e4a', '6ff5e3a2-6c0c-420f-ac59-a6be6c232e58', '66c9b076-005f-493a-b96f-5c4d7593aa36', 'd3f5dbea-9ee0-4797-a731-090467c2463b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:20 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:20 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:21 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.382s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:21 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Deleted volume successfully. Aug 26 12:12:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1d30ba89-9933-48df-8a53-26e63a9bc554 tempest-CreateVolumesFromSnapshotTest-1569825084 None] Lock "cinder-40d5c45d-8d58-4f36-86e7-106f7749cea9-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Flow 'volume_create_manager' (9b6f5034-56a2-430c-9284-5281e0fed788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79ee65d-8530-4b2c-a0e4-1ec71919f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79ee65d-8530-4b2c-a0e4-1ec71919f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5830ab-955b-4859-9e38-5c108928aaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b73e6091334bbfb472c1d81493a81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:25Z,use_quota=True,user_id='f6243f89021f42f0b78cf3cd774a4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf772e3-1c10-4ace-b771-a4414286cce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf772e3-1c10-4ace-b771-a4414286cce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263071fc-a169-4fd2-bfed-fdbb801c3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263071fc-a169-4fd2-bfed-fdbb801c3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c5830ab-955b-4859-9e38-5c108928aaeb', 'volume_name': 'volume-0c5830ab-955b-4859-9e38-5c108928aaeb', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57224c4e-9c15-40dd-b5d8-19b44e5e37e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57224c4e-9c15-40dd-b5d8-19b44e5e37e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b99a6d2-6256-445c-86a3-20aa1996c3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:25 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Volume 0c5830ab-955b-4859-9e38-5c108928aaeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c5830ab-955b-4859-9e38-5c108928aaeb', 'volume_size': 1} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5830ab-955b-4859-9e38-5c108928aaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b73e6091334bbfb472c1d81493a81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:25Z,use_quota=True,user_id='f6243f89021f42f0b78cf3cd774a4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Creating volume 0c5830ab-955b-4859-9e38-5c108928aaeb {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:12:25 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:12:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:25 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb 1073741824 Aug 26 12:12:25 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:26 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb 1073741824" returned: 0 in 0.520s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:26 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb Aug 26 12:12:26 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:26 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb" returned: 0 in 0.297s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b99a6d2-6256-445c-86a3-20aa1996c3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c5830ab-955b-4859-9e38-5c108928aaeb', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7df3f62-99e0-4449-a42b-c714dd1761b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "cinder-5532d511-f1d7-42ff-9751-ce08e0c492f2-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:26 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Volume volume-0c5830ab-955b-4859-9e38-5c108928aaeb (0c5830ab-955b-4859-9e38-5c108928aaeb): created successfully Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7df3f62-99e0-4449-a42b-c714dd1761b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Flow 'volume_create_manager' (9b6f5034-56a2-430c-9284-5281e0fed788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "cinder-5532d511-f1d7-42ff-9751-ce08e0c492f2-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:26 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e852b807-edb9-4546-a730-2a061c83c648 tempest-CinderUnicodeTest-1516079989 None] Created volume successfully. Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "cinder-quobyte-5532d511-f1d7-42ff-9751-ce08e0c492f2" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "cinder-quobyte-5532d511-f1d7-42ff-9751-ce08e0c492f2" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a879a2-0ff3-42d8-97aa-6d09f24bbbd5]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:26 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 Aug 26 12:12:26 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:26 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2" returned: 0 in 0.411s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:27 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2 Aug 26 12:12:27 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:27 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5532d511-f1d7-42ff-9751-ce08e0c492f2" returned: 0 in 0.337s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Flow 'volume_create_manager' (b73e7b68-7285-4a91-9758-dd1d577dd0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d42b70-d174-47e5-8067-65d4a1236e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "cinder-quobyte-5532d511-f1d7-42ff-9751-ce08e0c492f2" released by "delete_volume" :: held 0.832s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d42b70-d174-47e5-8067-65d4a1236e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-662779548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdb3319-f7f3-4d30-bba6-c4e55b355694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15b01bd067c4f7b8251b08b316f8935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:27Z,use_quota=True,user_id='80475a0cd02f4fdb8084bd0ab0463d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408c8d35-e3b8-477d-871b-9538b0715bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408c8d35-e3b8-477d-871b-9538b0715bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c6a73e-af4a-46f3-8374-346ea1e4e191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c6a73e-af4a-46f3-8374-346ea1e4e191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fdb3319-f7f3-4d30-bba6-c4e55b355694', 'volume_name': 'volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f3311f-4ac2-4b13-9e68-a1f20c5fd912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f3311f-4ac2-4b13-9e68-a1f20c5fd912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0e9553-86eb-4d48-9a44-83dbc64e4681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:27 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Volume 1fdb3319-f7f3-4d30-bba6-c4e55b355694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694', 'volume_size': 1} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-662779548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdb3319-f7f3-4d30-bba6-c4e55b355694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15b01bd067c4f7b8251b08b316f8935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:27Z,use_quota=True,user_id='80475a0cd02f4fdb8084bd0ab0463d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Creating volume 1fdb3319-f7f3-4d30-bba6-c4e55b355694 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:12:27 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:27 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 1073741824 Aug 26 12:12:27 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Created reservations ['d0f50dd7-1134-45dc-b219-5acea9ed9125', '500de5ec-c0e5-4d94-927e-962bc924c45c', '8199ee2a-0c05-46ef-8f7a-8956263f9cfe', 'f4ed4a9b-c55d-4ff9-8401-519efb0859a2'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:27 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:27 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:27 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.299s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:27 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Deleted volume successfully. Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-684e11f2-817c-4240-8297-bfbe9556647e tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "cinder-5532d511-f1d7-42ff-9751-ce08e0c492f2-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:28 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 1073741824" returned: 0 in 0.673s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:28 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 Aug 26 12:12:28 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Flow 'volume_create_manager' (1eb523d8-0971-4aca-8c03-765e7c11f9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a1c7c8-8081-446b-b2ca-4d88f1c31af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a1c7c8-8081-446b-b2ca-4d88f1c31af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-553621786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136607d1-dd24-41cd-a0cd-2c62273eafe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b73e6091334bbfb472c1d81493a81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:28Z,use_quota=True,user_id='f6243f89021f42f0b78cf3cd774a4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7e2e78-7428-4a98-a1b3-866ce7b6fe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7e2e78-7428-4a98-a1b3-866ce7b6fe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455bc617-9cc7-48f6-9353-d4b7eacf62e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455bc617-9cc7-48f6-9353-d4b7eacf62e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136607d1-dd24-41cd-a0cd-2c62273eafe3', 'volume_name': 'volume-136607d1-dd24-41cd-a0cd-2c62273eafe3', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc797ae-03cd-4484-956c-bf2112970e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc797ae-03cd-4484-956c-bf2112970e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f250f14d-577f-4432-928c-b6c8301f36c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:28 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Volume 136607d1-dd24-41cd-a0cd-2c62273eafe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136607d1-dd24-41cd-a0cd-2c62273eafe3', 'volume_size': 1} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:28 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694" returned: 0 in 0.414s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-553621786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136607d1-dd24-41cd-a0cd-2c62273eafe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b73e6091334bbfb472c1d81493a81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:28Z,use_quota=True,user_id='f6243f89021f42f0b78cf3cd774a4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Creating volume 136607d1-dd24-41cd-a0cd-2c62273eafe3 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:12:28 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0e9553-86eb-4d48-9a44-83dbc64e4681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e569339e-aa69-44c2-acc9-19a0a2390b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:28 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 1073741824 Aug 26 12:12:28 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:28 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Volume volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 (1fdb3319-f7f3-4d30-bba6-c4e55b355694): created successfully Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e569339e-aa69-44c2-acc9-19a0a2390b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Flow 'volume_create_manager' (b73e7b68-7285-4a91-9758-dd1d577dd0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8dd4eb33-02e2-4ac5-a732-0c75bdb4ae41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Created volume successfully. Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "cinder-4c846c99-78bf-4e79-ace4-72fc9b8e3107-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "cinder-4c846c99-78bf-4e79-ace4-72fc9b8e3107-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "cinder-quobyte-4c846c99-78bf-4e79-ace4-72fc9b8e3107" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "cinder-quobyte-4c846c99-78bf-4e79-ace4-72fc9b8e3107" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[db933793-9536-4063-9943-aef23f7ea384]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:29 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 Aug 26 12:12:29 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:29 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 1073741824" returned: 0 in 0.797s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:29 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107" returned: 0 in 0.577s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:29 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 Aug 26 12:12:29 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:29 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107 Aug 26 12:12:29 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:29 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3" returned: 0 in 0.345s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:29 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4c846c99-78bf-4e79-ace4-72fc9b8e3107" returned: 0 in 0.335s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f250f14d-577f-4432-928c-b6c8301f36c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136607d1-dd24-41cd-a0cd-2c62273eafe3', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a116762-87e8-4097-ad97-511e9aaca18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "cinder-quobyte-4c846c99-78bf-4e79-ace4-72fc9b8e3107" released by "delete_volume" :: held 1.013s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:29 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Volume volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 (136607d1-dd24-41cd-a0cd-2c62273eafe3): created successfully Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a116762-87e8-4097-ad97-511e9aaca18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Flow 'volume_create_manager' (1eb523d8-0971-4aca-8c03-765e7c11f9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:29 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a367c826-79b8-454c-8177-26b5ca3e8136 tempest-CinderUnicodeTest-1516079989 None] Created volume successfully. Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Created reservations ['9ffe44b2-8f6c-4a6b-81bc-4cf4c7ff35b1', 'd0bd70a3-0ccb-4092-b27e-17ece0b7e195', 'a99e2e0f-5f4d-4a82-b77e-bc4e9ba2d7f0', 'b0da1aae-fe8e-4e8b-bb2a-a4725100148d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:30 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:30 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:30 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.357s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Deleted volume successfully. Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-25072cee-cb37-4a9e-8fd9-4fd57c784e64 tempest-TestServerVolumeAttachmentScenario-759760161 None] Lock "cinder-4c846c99-78bf-4e79-ace4-72fc9b8e3107-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-7c06267e-7f1d-4d37-99e1-8be26a98dedf req-6f56099b-5032-45a5-82da-f4557e3e9de1 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-7c06267e-7f1d-4d37-99e1-8be26a98dedf req-6f56099b-5032-45a5-82da-f4557e3e9de1 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-7c06267e-7f1d-4d37-99e1-8be26a98dedf req-6f56099b-5032-45a5-82da-f4557e3e9de1 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-7c06267e-7f1d-4d37-99e1-8be26a98dedf req-6f56099b-5032-45a5-82da-f4557e3e9de1 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9221c0d-c4e8-4acf-9657-15a72ce11b04', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:12:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-7c06267e-7f1d-4d37-99e1-8be26a98dedf req-6f56099b-5032-45a5-82da-f4557e3e9de1 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] attachment_update completed successfully. Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Creating offline snapshot 5c6f0fae-a463-4f97-9294-4fd038272faf of volume 136607d1-dd24-41cd-a0cd-2c62273eafe3 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c79061-8640-4bfd-9de4-bedb1fe6a664]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:30 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 Aug 26 12:12:30 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:31 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3" returned: 0 in 0.481s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:31 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf 1G Aug 26 12:12:31 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:31 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf 1G" returned: 0 in 0.645s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:31 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf Aug 26 12:12:31 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:32 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf" returned: 0 in 0.399s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:32 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf is being set with open permissions: ugo+rw Aug 26 12:12:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:32 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf Aug 26 12:12:32 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:32 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf" returned: 0 in 0.319s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:32 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.info Aug 26 12:12:32 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:32 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.info" returned: 0 in 0.324s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:32 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.info is being set with open permissions: ugo+rw Aug 26 12:12:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:33 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.info Aug 26 12:12:33 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:33 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.info" returned: 0 in 0.316s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:33 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-9bc6d0e1-b4a8-43ce-a723-472b4da47a91 tempest-CinderUnicodeTest-1516079989 None] Create snapshot completed successfully Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "cinder-5c6f0fae-a463-4f97-9294-4fd038272faf-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-5c6f0fae-a463-4f97-9294-4fd038272faf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "cinder-quobyte-136607d1-dd24-41cd-a0cd-2c62273eafe3" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-quobyte-136607d1-dd24-41cd-a0cd-2c62273eafe3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "cinder-quobyte-5c6f0fae-a463-4f97-9294-4fd038272faf" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-quobyte-5c6f0fae-a463-4f97-9294-4fd038272faf" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Deleting offline snapshot 5c6f0fae-a463-4f97-9294-4fd038272faf of volume 136607d1-dd24-41cd-a0cd-2c62273eafe3 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] snapshot_file for this snap is: volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b1f26d-3a3d-42ef-9c3b-86fde02f4119]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:34 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf Aug 26 12:12:34 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-2e2cf2b8-d349-4935-91cc-8a5d50f9b49f req-982dee21-95c8-4ffe-b123-618e280d1b5f tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Terminate volume connection completed successfully. Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-2e2cf2b8-d349-4935-91cc-8a5d50f9b49f req-982dee21-95c8-4ffe-b123-618e280d1b5f tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Deleting attachment f9221c0d-c4e8-4acf-9657-15a72ce11b04. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:12:34 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf" returned: 0 in 0.485s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136607d1-dd24-41cd-a0cd-2c62273eafe3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abf5f46-d9e8-4695-9494-aa2e6042b34f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:34 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 Aug 26 12:12:34 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:35 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3" returned: 0 in 0.446s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:35 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf Aug 26 12:12:35 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Acquiring lock "cinder-1fdb3319-f7f3-4d30-bba6-c4e55b355694-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "cinder-1fdb3319-f7f3-4d30-bba6-c4e55b355694-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Acquiring lock "cinder-quobyte-1fdb3319-f7f3-4d30-bba6-c4e55b355694" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "cinder-quobyte-1fdb3319-f7f3-4d30-bba6-c4e55b355694" acquired by "delete_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f877c37a-321e-412a-938a-7ee46f837075]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:35 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 Aug 26 12:12:35 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:35 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf" returned: 0 in 0.551s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:35 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf Aug 26 12:12:35 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:35 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694" returned: 0 in 0.474s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:35 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694 Aug 26 12:12:35 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:36 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3.5c6f0fae-a463-4f97-9294-4fd038272faf" returned: 0 in 0.340s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-quobyte-5c6f0fae-a463-4f97-9294-4fd038272faf" released by "_delete_snapshot" :: held 1.974s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-quobyte-136607d1-dd24-41cd-a0cd-2c62273eafe3" released by "delete_snapshot" :: held 2.008s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Created reservations ['bf82cf1d-1dba-4d0a-a6c1-f9878a2fe700', '1da93e6a-6516-4e09-9985-c48640c2fb16', 'aa7efe12-2797-4cab-8171-791b856bd377', 'a56bbec2-d018-481e-a13a-2b5ecf8eb5f3'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:36 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1fdb3319-f7f3-4d30-bba6-c4e55b355694" returned: 0 in 0.305s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "cinder-quobyte-1fdb3319-f7f3-4d30-bba6-c4e55b355694" released by "delete_volume" :: held 0.840s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Delete snapshot completed successfully. Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-544f83c1-020f-4136-b246-8af449dce011 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-5c6f0fae-a463-4f97-9294-4fd038272faf-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Created reservations ['99e76fa5-f7f2-4870-b3c8-484a28aa1b02', 'dfc242a6-239f-40a2-8b66-92a6f351e033', 'ce542d90-269e-4e16-af5b-e408010e9bbc', '25ef87dd-208e-44ef-a782-7c2a718fdc5a'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:36 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:36 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:36 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.397s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Deleted volume successfully. Aug 26 12:12:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-648b898e-0b4d-49d0-9111-97afb2b9cf41 tempest-TestServerVolumeAttachScenarioOldVersion-612218179 None] Lock "cinder-1fdb3319-f7f3-4d30-bba6-c4e55b355694-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "cinder-136607d1-dd24-41cd-a0cd-2c62273eafe3-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-136607d1-dd24-41cd-a0cd-2c62273eafe3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "cinder-quobyte-136607d1-dd24-41cd-a0cd-2c62273eafe3" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-quobyte-136607d1-dd24-41cd-a0cd-2c62273eafe3" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:37 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f5f703-b1c7-434e-9d30-033fed558015]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:37 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 Aug 26 12:12:37 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:38 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3" returned: 0 in 0.448s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:38 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3 Aug 26 12:12:38 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:38 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-136607d1-dd24-41cd-a0cd-2c62273eafe3" returned: 0 in 0.307s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-quobyte-136607d1-dd24-41cd-a0cd-2c62273eafe3" released by "delete_volume" :: held 0.833s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Created reservations ['0c0dba69-8a81-491d-91e6-72a054d1de7e', 'e0c6fa96-8f2a-4633-98a6-d6e540c42f98', 'a992d894-4d65-4a88-b967-7928838b01f5', '7b28015b-79db-4c44-a98b-5047eb94e564'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:38 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:38 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "cinder-0c5830ab-955b-4859-9e38-5c108928aaeb-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-0c5830ab-955b-4859-9e38-5c108928aaeb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "cinder-quobyte-0c5830ab-955b-4859-9e38-5c108928aaeb" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-quobyte-0c5830ab-955b-4859-9e38-5c108928aaeb" acquired by "delete_volume" :: waited 0.040s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[429ed85b-d2cd-465b-9752-1ff97110e2a1]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:38 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.425s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:38 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:38 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Deleted volume successfully. Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c0b7e8-b2c2-43a2-a503-9a83e3c4a3b0 tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-136607d1-dd24-41cd-a0cd-2c62273eafe3-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:39 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb Aug 26 12:12:39 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:39 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb" returned: 0 in 0.502s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:39 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb Aug 26 12:12:39 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:39 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0c5830ab-955b-4859-9e38-5c108928aaeb" returned: 0 in 0.310s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-quobyte-0c5830ab-955b-4859-9e38-5c108928aaeb" released by "delete_volume" :: held 0.892s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Created reservations ['c32243cd-bc59-4913-83ca-9ac70b4b05e9', '106011ec-220c-4035-b3f6-bea89c3f312e', '8fb058ac-dcec-4cde-925b-5ad506dc39c2', '684e2b9d-0452-4ad5-83b3-9730d193c54f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:39 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:12:39 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:40 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.340s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:40 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:12:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Deleted volume successfully. Aug 26 12:12:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-135b2465-d831-4baf-8391-cafbc4fc76db tempest-CinderUnicodeTest-1516079989 None] Lock "cinder-0c5830ab-955b-4859-9e38-5c108928aaeb-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:12:49 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:INSERT=20,cinder:UPDATE=66,cinder:SELECT=46,cinder:DELETE=3 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:12:50 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=56,cinder:INSERT=12,cinder:UPDATE=64,cinder:DELETE=7 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Flow 'volume_create_manager' (24db055b-27e5-462a-8d42-530d3a6273e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0584bc-0e8b-4012-9be7-7cd3abab30f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0584bc-0e8b-4012-9be7-7cd3abab30f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1608687278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f393dd-ac9f-4def-890e-3f1f041b4343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acef6584b1d0414f8b905d9529df952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:52Z,use_quota=True,user_id='3bc510c296a840d5aa76f2558f7113bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26b7dd7-92bc-4bfc-9291-7ba4e9f68110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26b7dd7-92bc-4bfc-9291-7ba4e9f68110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d325e14b-6408-4a10-a5ac-040b132b3bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d325e14b-6408-4a10-a5ac-040b132b3bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f393dd-ac9f-4def-890e-3f1f041b4343', 'volume_name': 'volume-d2f393dd-ac9f-4def-890e-3f1f041b4343', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37970cd4-6ee3-456d-a91d-1a6a72185027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37970cd4-6ee3-456d-a91d-1a6a72185027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef103e10-6ddf-4ada-91c5-87823cd17e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:52 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Volume d2f393dd-ac9f-4def-890e-3f1f041b4343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f393dd-ac9f-4def-890e-3f1f041b4343', 'volume_size': 1} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1608687278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f393dd-ac9f-4def-890e-3f1f041b4343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acef6584b1d0414f8b905d9529df952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:12:52Z,use_quota=True,user_id='3bc510c296a840d5aa76f2558f7113bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Creating volume d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:12:52 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:52 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 1073741824 Aug 26 12:12:52 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:52 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 1073741824" returned: 0 in 0.621s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:12:52 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 Aug 26 12:12:52 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:12:53 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Aug 26 12:12:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343" returned: 0 in 0.334s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:12:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:12:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:12:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef103e10-6ddf-4ada-91c5-87823cd17e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f393dd-ac9f-4def-890e-3f1f041b4343', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e535bdf5-9103-4329-8358-face393f38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:12:53 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Volume volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 (d2f393dd-ac9f-4def-890e-3f1f041b4343): created successfully Aug 26 12:12:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e535bdf5-9103-4329-8358-face393f38ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:12:53 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Flow 'volume_create_manager' (24db055b-27e5-462a-8d42-530d3a6273e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:12:53 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2249b319-11aa-4d84-ad7b-00af743e852f tempest-TestStampPattern-753289935 None] Created volume successfully. Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Flow 'volume_create_manager' (558f751c-e779-48d9-9c94-c3ffb6690d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb912157-0bd0-4923-be27-b2c24bfa29f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb912157-0bd0-4923-be27-b2c24bfa29f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-625311196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca24e338-d52a-4102-b5ea-8d4c095354d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188697074ced455c90b00949328702aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:03Z,use_quota=True,user_id='ae2c04e62e2a45f89a0e732e1f8b1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba07db1-9788-4b20-99be-d3d4af64bb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba07db1-9788-4b20-99be-d3d4af64bb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d8c07c-b7c2-49dd-b3eb-716afe85d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d8c07c-b7c2-49dd-b3eb-716afe85d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca24e338-d52a-4102-b5ea-8d4c095354d0', 'volume_name': 'volume-ca24e338-d52a-4102-b5ea-8d4c095354d0', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97360cc4-e85c-4689-9bfe-8bf549e4096c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97360cc4-e85c-4689-9bfe-8bf549e4096c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bab42a-b3b5-4f1a-964f-d48c1f25b6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:03 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Volume ca24e338-d52a-4102-b5ea-8d4c095354d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca24e338-d52a-4102-b5ea-8d4c095354d0', 'volume_size': 1} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-625311196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca24e338-d52a-4102-b5ea-8d4c095354d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188697074ced455c90b00949328702aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:03Z,use_quota=True,user_id='ae2c04e62e2a45f89a0e732e1f8b1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Creating volume ca24e338-d52a-4102-b5ea-8d4c095354d0 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:13:03 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:03 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 1073741824 Aug 26 12:13:03 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:03 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 1073741824" returned: 0 in 0.682s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:03 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 Aug 26 12:13:03 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:04 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0" returned: 0 in 0.292s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:13:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bab42a-b3b5-4f1a-964f-d48c1f25b6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca24e338-d52a-4102-b5ea-8d4c095354d0', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c1a11e-af26-4838-a010-9466e4d7870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:04 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Volume volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 (ca24e338-d52a-4102-b5ea-8d4c095354d0): created successfully Aug 26 12:13:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c1a11e-af26-4838-a010-9466e4d7870d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Flow 'volume_create_manager' (558f751c-e779-48d9-9c94-c3ffb6690d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:04 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f0a196bb-d9db-4367-bf2b-cad5f32f07a5 tempest-ProjectReaderTests-2067667299 None] Created volume successfully. Aug 26 12:13:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "cinder-ca24e338-d52a-4102-b5ea-8d4c095354d0-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-ca24e338-d52a-4102-b5ea-8d4c095354d0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "cinder-quobyte-ca24e338-d52a-4102-b5ea-8d4c095354d0" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-quobyte-ca24e338-d52a-4102-b5ea-8d4c095354d0" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:05 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e1e4c7-6877-4aa1-a132-a07039ad5fae]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:05 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 Aug 26 12:13:05 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:06 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0" returned: 0 in 0.794s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:06 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0 Aug 26 12:13:06 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:07 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ca24e338-d52a-4102-b5ea-8d4c095354d0" returned: 0 in 0.529s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-quobyte-ca24e338-d52a-4102-b5ea-8d4c095354d0" released by "delete_volume" :: held 1.398s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Created reservations ['99fa88cc-b03b-4974-9a61-dba6b01e0603', '2f32e5c7-2c16-4202-91f0-cb652dac9c4f', 'a4577600-adfc-48d7-95cd-31275d3c1fd8', 'd21c37c2-4b17-44b2-8ba6-253bae9bece8'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:07 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:13:07 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:07 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.345s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:13:07 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Deleted volume successfully. Aug 26 12:13:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e0a63808-60be-4bdf-ab08-bb4211ee1d02 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-ca24e338-d52a-4102-b5ea-8d4c095354d0-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Flow 'volume_create_manager' (1ef3e8f9-1613-4677-ad6d-368a36f3f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365604fe-42d8-4906-91c6-3f0975e9cc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365604fe-42d8-4906-91c6-3f0975e9cc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537119668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb591d0-de57-4956-a925-dc165910daee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188697074ced455c90b00949328702aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:09Z,use_quota=True,user_id='ae2c04e62e2a45f89a0e732e1f8b1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543ee5e9-4804-41ff-be49-bd2d6a06f970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543ee5e9-4804-41ff-be49-bd2d6a06f970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9273596f-c2ab-4067-a33a-010eaf9de321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9273596f-c2ab-4067-a33a-010eaf9de321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb591d0-de57-4956-a925-dc165910daee', 'volume_name': 'volume-bdb591d0-de57-4956-a925-dc165910daee', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddddcbd5-093b-4df0-9cbd-7aa10b047cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddddcbd5-093b-4df0-9cbd-7aa10b047cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38aeb04-76eb-45e8-b108-1961d760581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:08 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Volume bdb591d0-de57-4956-a925-dc165910daee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb591d0-de57-4956-a925-dc165910daee', 'volume_size': 1} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537119668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb591d0-de57-4956-a925-dc165910daee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188697074ced455c90b00949328702aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:09Z,use_quota=True,user_id='ae2c04e62e2a45f89a0e732e1f8b1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Creating volume bdb591d0-de57-4956-a925-dc165910daee {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:13:08 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:13:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:08 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee 1073741824 Aug 26 12:13:08 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:09 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee 1073741824" returned: 0 in 0.839s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:09 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee Aug 26 12:13:09 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:10 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee" returned: 0 in 0.361s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38aeb04-76eb-45e8-b108-1961d760581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb591d0-de57-4956-a925-dc165910daee', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1dee5e-3e86-40e8-97cd-1dd3c7820d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:10 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Volume volume-bdb591d0-de57-4956-a925-dc165910daee (bdb591d0-de57-4956-a925-dc165910daee): created successfully Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1dee5e-3e86-40e8-97cd-1dd3c7820d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Flow 'volume_create_manager' (1ef3e8f9-1613-4677-ad6d-368a36f3f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-cf3e4bb5-578b-4423-8aa3-a00e2e456ae3 tempest-ProjectReaderTests-2067667299 None] Created volume successfully. Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:10 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:13:10 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "cinder-bdb591d0-de57-4956-a925-dc165910daee-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-bdb591d0-de57-4956-a925-dc165910daee-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "cinder-quobyte-bdb591d0-de57-4956-a925-dc165910daee" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:11 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.479s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-quobyte-bdb591d0-de57-4956-a925-dc165910daee" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cf2a36-7fc6-414e-87d3-09dec9ebe790]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:11 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee Aug 26 12:13:11 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:11 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee" returned: 0 in 0.686s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:11 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee Aug 26 12:13:11 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:12 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-bdb591d0-de57-4956-a925-dc165910daee" returned: 0 in 0.448s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-quobyte-bdb591d0-de57-4956-a925-dc165910daee" released by "delete_volume" :: held 1.203s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Created reservations ['fa9a8daa-ca30-4921-a47e-f01422534227', '74c8e4b2-11d0-495e-bf8a-0087a3701bbc', '8780ae3c-6366-4f2f-be2b-7c304574a5f9', '035fadb1-04f7-40a1-bbfc-79a91fb1de88'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:12 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:13:12 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:12 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.303s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:13:12 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Deleted volume successfully. Aug 26 12:13:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-adb083e6-f08a-408d-bbb4-71bc17feb180 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-bdb591d0-de57-4956-a925-dc165910daee-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Flow 'volume_create_manager' (1a39e587-7027-4f07-85a3-5588e32b303c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345a9b93-d326-4857-bf55-09d9ddf71d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345a9b93-d326-4857-bf55-09d9ddf71d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1848183243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece5b2b9-07eb-4871-842c-e5ffd3088913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188697074ced455c90b00949328702aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:14Z,use_quota=True,user_id='ae2c04e62e2a45f89a0e732e1f8b1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a407c951-69d2-447a-ab97-81cd56dfa4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a407c951-69d2-447a-ab97-81cd56dfa4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b27573-eee6-498a-98ce-edc8930585ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b27573-eee6-498a-98ce-edc8930585ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece5b2b9-07eb-4871-842c-e5ffd3088913', 'volume_name': 'volume-ece5b2b9-07eb-4871-842c-e5ffd3088913', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae8a5d6-31d0-40d1-b546-5ba55560d326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae8a5d6-31d0-40d1-b546-5ba55560d326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ca3f6f-c7ad-466d-a811-29477e1d374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:14 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Volume ece5b2b9-07eb-4871-842c-e5ffd3088913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece5b2b9-07eb-4871-842c-e5ffd3088913', 'volume_size': 1} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1848183243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece5b2b9-07eb-4871-842c-e5ffd3088913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188697074ced455c90b00949328702aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:14Z,use_quota=True,user_id='ae2c04e62e2a45f89a0e732e1f8b1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Creating volume ece5b2b9-07eb-4871-842c-e5ffd3088913 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:13:14 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:13:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:14 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 1073741824 Aug 26 12:13:14 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:15 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 1073741824" returned: 0 in 0.770s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:15 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 Aug 26 12:13:15 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:15 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913" returned: 0 in 0.430s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:13:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ca3f6f-c7ad-466d-a811-29477e1d374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece5b2b9-07eb-4871-842c-e5ffd3088913', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a75731-ab29-4321-8e33-6020dd1751a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:15 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Volume volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 (ece5b2b9-07eb-4871-842c-e5ffd3088913): created successfully Aug 26 12:13:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a75731-ab29-4321-8e33-6020dd1751a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Flow 'volume_create_manager' (1a39e587-7027-4f07-85a3-5588e32b303c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-da87a17a-5eec-4901-9140-a563c0eea0d4 tempest-ProjectReaderTests-2067667299 None] Created volume successfully. Aug 26 12:13:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "cinder-ece5b2b9-07eb-4871-842c-e5ffd3088913-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-ece5b2b9-07eb-4871-842c-e5ffd3088913-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "cinder-quobyte-ece5b2b9-07eb-4871-842c-e5ffd3088913" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-quobyte-ece5b2b9-07eb-4871-842c-e5ffd3088913" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:16 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0f2814-a07a-4130-816f-30263fbab49b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:16 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 Aug 26 12:13:16 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:17 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913" returned: 0 in 0.695s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:17 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913 Aug 26 12:13:17 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:17 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ece5b2b9-07eb-4871-842c-e5ffd3088913" returned: 0 in 0.504s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-quobyte-ece5b2b9-07eb-4871-842c-e5ffd3088913" released by "delete_volume" :: held 1.266s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Created reservations ['f13f7117-3647-49e9-aa5c-bc606591834c', 'e9c6217b-a6ee-43c1-bf05-380a5d276fdf', 'cd17a8bf-c824-4622-8bcf-daa01e1d533a', '6a5daed9-6938-4287-a31d-7182db0fdc90'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:17 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:13:17 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:18 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.393s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:18 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:13:18 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Deleted volume successfully. Aug 26 12:13:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7d6576dd-770d-49d5-864d-6dc30a6b8a94 tempest-ProjectReaderTests-2067667299 None] Lock "cinder-ece5b2b9-07eb-4871-842c-e5ffd3088913-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Flow 'volume_create_manager' (0f31a901-42c2-43ca-8c8e-61ba7c0e6dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08018502-638f-41dc-8ce6-d23cf3af2a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08018502-638f-41dc-8ce6-d23cf3af2a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-656018784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e13223-5869-4795-b3fc-3e5eff1aa9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188697074ced455c90b00949328702aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:19Z,use_quota=True,user_id='ae2c04e62e2a45f89a0e732e1f8b1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bfe420-5683-40ba-8d00-67cb4747b0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bfe420-5683-40ba-8d00-67cb4747b0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3a94e6-d68a-4c9f-a184-e5ae079c6713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3a94e6-d68a-4c9f-a184-e5ae079c6713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e13223-5869-4795-b3fc-3e5eff1aa9cc', 'volume_name': 'volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724fc14c-e364-4590-b815-2957fcee4856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724fc14c-e364-4590-b815-2957fcee4856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe4b79e-096d-43a8-bffb-440941791de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:19 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Volume e0e13223-5869-4795-b3fc-3e5eff1aa9cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc', 'volume_size': 1} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-656018784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e13223-5869-4795-b3fc-3e5eff1aa9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188697074ced455c90b00949328702aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:19Z,use_quota=True,user_id='ae2c04e62e2a45f89a0e732e1f8b1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Creating volume e0e13223-5869-4795-b3fc-3e5eff1aa9cc {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:13:19 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:13:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:19 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc 1073741824 Aug 26 12:13:19 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:20 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc 1073741824" returned: 0 in 0.763s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:20 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc Aug 26 12:13:20 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:20 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc" returned: 0 in 0.357s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:20 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:13:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe4b79e-096d-43a8-bffb-440941791de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4764db-d701-4c0c-bab3-6a44486e2868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:20 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Volume volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc (e0e13223-5869-4795-b3fc-3e5eff1aa9cc): created successfully Aug 26 12:13:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4764db-d701-4c0c-bab3-6a44486e2868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:20 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Flow 'volume_create_manager' (0f31a901-42c2-43ca-8c8e-61ba7c0e6dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:20 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-06c6ac3f-ef6b-4047-b24e-ccddae558af4 tempest-ProjectReaderTests-2067667299 None] Created volume successfully. Aug 26 12:13:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Acquiring lock "cinder-e0e13223-5869-4795-b3fc-3e5eff1aa9cc-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Lock "cinder-e0e13223-5869-4795-b3fc-3e5eff1aa9cc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Acquiring lock "cinder-quobyte-e0e13223-5869-4795-b3fc-3e5eff1aa9cc" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Lock "cinder-quobyte-e0e13223-5869-4795-b3fc-3e5eff1aa9cc" acquired by "delete_volume" :: waited 0.035s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:21 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[618e5789-aa16-46e6-8cb5-117765dbabac]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:21 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc Aug 26 12:13:21 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:22 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc" returned: 0 in 0.551s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:22 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc Aug 26 12:13:22 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:22 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e0e13223-5869-4795-b3fc-3e5eff1aa9cc" returned: 0 in 0.356s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Lock "cinder-quobyte-e0e13223-5869-4795-b3fc-3e5eff1aa9cc" released by "delete_volume" :: held 0.987s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Created reservations ['f18ff9d9-69ab-447f-b762-bb0a3b683701', 'de68246b-7daa-40a4-b17c-f5434e5c060d', 'e376f88c-6bf7-4ca7-92bb-c958e0d579b4', '1e64b552-5215-467e-afc1-4186048c3915'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:22 devstack sudo[109407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:13:22 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:23 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.410s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:13:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Deleted volume successfully. Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ccc14248-f3f0-4465-afa2-cade4a67328a tempest-ProjectReaderTests-2067667299 None] Lock "cinder-e0e13223-5869-4795-b3fc-3e5eff1aa9cc-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Flow 'volume_create_manager' (edf084e2-cf82-47dc-927b-b6948e02c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecaeed5a-62be-4cae-b044-d88bcad5ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecaeed5a-62be-4cae-b044-d88bcad5ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1412731490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007ad5c2-46e9-4344-a50e-1bd1606f4359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0c2a64df6048a7991fd09b2ccd677a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:23Z,use_quota=True,user_id='ff4f40d392604edf99dd5d847fbfa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b2e9ea-a0a1-47b3-a39a-979e72c1f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b2e9ea-a0a1-47b3-a39a-979e72c1f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1247a2c-a14c-4315-8bab-43338a0c375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1247a2c-a14c-4315-8bab-43338a0c375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '007ad5c2-46e9-4344-a50e-1bd1606f4359', 'volume_name': 'volume-007ad5c2-46e9-4344-a50e-1bd1606f4359', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7d2868-b7fd-479c-adcc-447450079064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7d2868-b7fd-479c-adcc-447450079064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b4e47d-9ef7-40da-a652-dc5a4b67314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:23 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Volume 007ad5c2-46e9-4344-a50e-1bd1606f4359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-007ad5c2-46e9-4344-a50e-1bd1606f4359', 'volume_size': 1} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1412731490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007ad5c2-46e9-4344-a50e-1bd1606f4359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0c2a64df6048a7991fd09b2ccd677a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:23Z,use_quota=True,user_id='ff4f40d392604edf99dd5d847fbfa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Creating volume 007ad5c2-46e9-4344-a50e-1bd1606f4359 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:13:23 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:13:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:23 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 1073741824 Aug 26 12:13:23 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:24 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 1073741824" returned: 0 in 0.664s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:24 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 Aug 26 12:13:24 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:24 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359" returned: 0 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:13:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b4e47d-9ef7-40da-a652-dc5a4b67314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-007ad5c2-46e9-4344-a50e-1bd1606f4359', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3412c6de-d98c-4d64-aef6-1a07256227b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:24 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Volume volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 (007ad5c2-46e9-4344-a50e-1bd1606f4359): created successfully Aug 26 12:13:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3412c6de-d98c-4d64-aef6-1a07256227b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:24 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Flow 'volume_create_manager' (edf084e2-cf82-47dc-927b-b6948e02c49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:24 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a8f8c1c9-3165-4bc5-a478-941d673b6a33 tempest-TestImageHashVerification-790478895 None] Created volume successfully. Aug 26 12:13:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88c5e8c-3d97-4e48-9328-abc7691ef933]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:26 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 Aug 26 12:13:26 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:27 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359" returned: 0 in 0.428s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:27 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5776db1a-d7c2-4fa4-953d-0dd6076417e6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:27 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 Aug 26 12:13:27 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:27 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359" returned: 0 in 0.512s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 /opt/stack/data/cinder/conversion/007ad5c2-46e9-4344-a50e-1bd1606f4359.temp_image.c5329f5f-3f20-4aba-a7ea-035d9a985ed2qujk28za.img {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:27 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 /opt/stack/data/cinder/conversion/007ad5c2-46e9-4344-a50e-1bd1606f4359.temp_image.c5329f5f-3f20-4aba-a7ea-035d9a985ed2qujk28za.img Aug 26 12:13:27 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:33 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 /opt/stack/data/cinder/conversion/007ad5c2-46e9-4344-a50e-1bd1606f4359.temp_image.c5329f5f-3f20-4aba-a7ea-035d9a985ed2qujk28za.img" returned: 0 in 6.112s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:33 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[859ef462-3093-46d5-b2c7-133a37a05eee]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:34 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 Aug 26 12:13:34 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:34 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359" returned: 0 in 0.611s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:34 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/conversion/007ad5c2-46e9-4344-a50e-1bd1606f4359.temp_image.c5329f5f-3f20-4aba-a7ea-035d9a985ed2qujk28za.img {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:13:34 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Converted 1024.00 MB image at 167.51 MB/s Aug 26 12:13:34 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] c5329f5f-3f20-4aba-a7ea-035d9a985ed2 was raw, no need to convert to raw {{(pid=94387) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 12:13:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-e4e99642-0c07-4e2a-8c58-025a9641316b req-705ca830-825a-4e87-9d67-d18341f38227 tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Flow 'volume_create_manager' (749c290c-5dec-4d78-a8c2-172f8b5833a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7990b8fc-ed66-4b09-b233-ce2e247fe099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7990b8fc-ed66-4b09-b233-ce2e247fe099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-153828883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb91ad6-64d5-43cd-8cc8-58cd7d532eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a240d5abe8fe450f85b16834851329b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:43Z,use_quota=True,user_id='a0a98b2f017a4aacb90cf9302918949c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc379be9-0d4c-4c15-8e08-297a4321542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc379be9-0d4c-4c15-8e08-297a4321542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d771e5c-2b01-4960-95cf-43d864dd1594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d771e5c-2b01-4960-95cf-43d864dd1594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ceb91ad6-64d5-43cd-8cc8-58cd7d532eff', 'volume_name': 'volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b16186-3401-4e57-b807-d78262377c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b16186-3401-4e57-b807-d78262377c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9bed75-3c14-4e33-b88b-f7cb805b1f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:13:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Volume ceb91ad6-64d5-43cd-8cc8-58cd7d532eff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 12:13:43 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Trying to clone ceb91ad6-64d5-43cd-8cc8-58cd7d532eff from image 014b1010-45ca-42a7-a54b-7655e36f8066 at location (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:13:44 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:13:44 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Image download 20.69 MB at 20.69 MB/s Aug 26 12:13:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bccda94-0a2e-4713-8e3e-5532b6a2aeb6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:44 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD Aug 26 12:13:44 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:44 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:44 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 is fetched for user a0a98b2f017a4aacb90cf9302918949c. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:13:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c726f548-8419-44ce-9022-35f945d5f481]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:44 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD Aug 26 12:13:44 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:44 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:50 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=52,cinder:INSERT=9,cinder:SELECT=35,cinder:DELETE=5 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:13:50 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=39,cinder:UPDATE=50,cinder:DELETE=5,cinder:INSERT=14 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.372s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Uploaded volume to glance image-id: c5329f5f-3f20-4aba-a7ea-035d9a985ed2. {{(pid=94387) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-e4e99642-0c07-4e2a-8c58-025a9641316b req-705ca830-825a-4e87-9d67-d18341f38227 tempest-TestStampPattern-753289935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.897s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-e4e99642-0c07-4e2a-8c58-025a9641316b req-705ca830-825a-4e87-9d67-d18341f38227 tempest-TestStampPattern-753289935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.285s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-153828883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb91ad6-64d5-43cd-8cc8-58cd7d532eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a240d5abe8fe450f85b16834851329b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:13:43Z,use_quota=True,user_id='a0a98b2f017a4aacb90cf9302918949c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Creating volume ceb91ad6-64d5-43cd-8cc8-58cd7d532eff {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:13:55 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:55 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a61cf164-466e-44a0-b6e1-4856e1b6d620 tempest-TestImageHashVerification-790478895 None] Copy volume to image completed successfully. Aug 26 12:13:55 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff 1073741824 Aug 26 12:13:55 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-e4e99642-0c07-4e2a-8c58-025a9641316b req-705ca830-825a-4e87-9d67-d18341f38227 tempest-TestStampPattern-753289935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-d2f393dd-ac9f-4def-890e-3f1f041b4343', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58537feb-aa6b-492b-9161-e463e95bf0cd', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:13:55 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-e4e99642-0c07-4e2a-8c58-025a9641316b req-705ca830-825a-4e87-9d67-d18341f38227 tempest-TestStampPattern-753289935 None] attachment_update completed successfully. Aug 26 12:13:55 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff 1073741824" returned: 0 in 0.540s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:55 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff Aug 26 12:13:55 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:56 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Acquiring lock "cinder-007ad5c2-46e9-4344-a50e-1bd1606f4359-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff" returned: 0 in 0.347s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Lock "cinder-007ad5c2-46e9-4344-a50e-1bd1606f4359-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Attempting download of 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume ceb91ad6-64d5-43cd-8cc8-58cd7d532eff. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Acquiring lock "cinder-quobyte-007ad5c2-46e9-4344-a50e-1bd1606f4359" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Lock "cinder-quobyte-007ad5c2-46e9-4344-a50e-1bd1606f4359" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba37531-1a53-4216-acb9-a7d83d4ee73d]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_qsn3cbug {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e3c94a-9906-478a-ad14-7646c5201e38]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:56 devstack sudo[109923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_qsn3cbug Aug 26 12:13:56 devstack sudo[109923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:56 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 Aug 26 12:13:56 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:56 devstack sudo[109923]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_qsn3cbug" returned: 0 in 0.383s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_qsn3cbug {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:56 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359" returned: 0 in 0.403s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:56 devstack sudo[109933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359 Aug 26 12:13:56 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:56 devstack sudo[109932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_qsn3cbug Aug 26 12:13:56 devstack sudo[109932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:56 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-007ad5c2-46e9-4344-a50e-1bd1606f4359" returned: 0 in 0.247s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Lock "cinder-quobyte-007ad5c2-46e9-4344-a50e-1bd1606f4359" released by "delete_volume" :: held 0.706s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:56 devstack sudo[109932]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_qsn3cbug" returned: 1 in 0.333s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014b1010-45ca-42a7-a54b-7655e36f8066_qsn3cbug' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0024ba4a-997b-4acf-92eb-ca79d8791ed0]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:56 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Created reservations ['bc413e81-bccd-4179-a65a-263490c2dfe7', 'b5095329-df2e-4075-bfdd-46e7ad8a9e20', '52d0d0a6-feb8-4a44-83e2-a838fbbdcf49', '39f6bd0e-fd0b-417b-9c99-53bdf253e0b3'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:57 devstack sudo[109939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD Aug 26 12:13:57 devstack sudo[109939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:57 devstack sudo[109942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:13:57 devstack sudo[109942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:57 devstack sudo[109942]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:13:57 devstack sudo[109939]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] 014b1010-45ca-42a7-a54b-7655e36f8066 was qcow2, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:57 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Deleted volume successfully. Aug 26 12:13:57 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff Aug 26 12:13:57 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f156920e-5938-47ba-a3b7-dd7f5e74c207 tempest-TestImageHashVerification-790478895 None] Lock "cinder-007ad5c2-46e9-4344-a50e-1bd1606f4359-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:13:59 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff" returned: 0 in 2.088s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014b1010-45ca-42a7-a54b-7655e36f8066_fz26e2lydevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:13:59 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Converted 112.00 MB image at 53.61 MB/s Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:13:59 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff 1G Aug 26 12:13:59 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:13:59 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff 1G" returned: 0 in 0.355s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Downloaded image 014b1010-45ca-42a7-a54b-7655e36f8066 ((None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}])) to volume ceb91ad6-64d5-43cd-8cc8-58cd7d532eff successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Temporary image 014b1010-45ca-42a7-a54b-7655e36f8066 for user a0a98b2f017a4aacb90cf9302918949c is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Marking volume ceb91ad6-64d5-43cd-8cc8-58cd7d532eff as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Copying metadata from image 014b1010-45ca-42a7-a54b-7655e36f8066 to ceb91ad6-64d5-43cd-8cc8-58cd7d532eff. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Creating volume glance metadata for volume ceb91ad6-64d5-43cd-8cc8-58cd7d532eff backed by image 014b1010-45ca-42a7-a54b-7655e36f8066 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9bed75-3c14-4e33-b88b-f7cb805b1f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff', 'volume_size': 1, 'image_id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014b1010-45ca-42a7-a54b-7655e36f8066', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c78f07ab73094e7098e6ce833cd8787c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014b1010-45ca-42a7-a54b-7655e36f8066', 'created_at': datetime.datetime(2026, 8, 26, 9, 53, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 9, 53, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014b1010-45ca-42a7-a54b-7655e36f8066/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:13:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9750ea5-1719-4d64-bbf8-7bcfd690b7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:00 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Volume volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff (ceb91ad6-64d5-43cd-8cc8-58cd7d532eff): created successfully Aug 26 12:14:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9750ea5-1719-4d64-bbf8-7bcfd690b7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Flow 'volume_create_manager' (749c290c-5dec-4d78-a8c2-172f8b5833a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a67604e3-2427-4792-b979-74be1aaa1030 tempest-TestShelveInstance-1172287496 None] Created volume successfully. Aug 26 12:14:01 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-a638302e-9eac-4d8a-a7a2-41b70bb3411e req-eecbd44a-e0c8-4cb4-be9b-c09c437a9c8a tempest-TestStampPattern-753289935 None] Terminate volume connection completed successfully. Aug 26 12:14:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-a638302e-9eac-4d8a-a7a2-41b70bb3411e req-eecbd44a-e0c8-4cb4-be9b-c09c437a9c8a tempest-TestStampPattern-753289935 None] Deleting attachment 58537feb-aa6b-492b-9161-e463e95bf0cd. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:14:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Creating offline snapshot 70fa28b4-49d6-453f-9a97-32afd58d819b of volume d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:14:01 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[65447734-4a92-4eb8-a1f2-d917951084d0]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:02 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 Aug 26 12:14:02 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:02 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343" returned: 0 in 0.448s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:02 devstack sudo[110036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b 1G Aug 26 12:14:02 devstack sudo[110036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:03 devstack sudo[110036]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b 1G" returned: 0 in 0.617s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:03 devstack sudo[110043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b Aug 26 12:14:03 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-9594e8ef-81f2-46b0-b525-a77b55b9436b req-8c7a587b-04d3-455e-84d0-3e7e9ba7984c tempest-TestShelveInstance-1172287496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:03 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b" returned: 0 in 0.390s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:03 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b is being set with open permissions: ugo+rw Aug 26 12:14:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:03 devstack sudo[110055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b Aug 26 12:14:03 devstack sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:03 devstack sudo[110055]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b" returned: 0 in 0.280s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:03 devstack sudo[110058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.info Aug 26 12:14:03 devstack sudo[110058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:04 devstack sudo[110058]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.info" returned: 0 in 0.300s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:04 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.info is being set with open permissions: ugo+rw Aug 26 12:14:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:04 devstack sudo[110061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.info Aug 26 12:14:04 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:04 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.info" returned: 0 in 0.306s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-9594e8ef-81f2-46b0-b525-a77b55b9436b req-8c7a587b-04d3-455e-84d0-3e7e9ba7984c tempest-TestShelveInstance-1172287496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.115s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-9594e8ef-81f2-46b0-b525-a77b55b9436b req-8c7a587b-04d3-455e-84d0-3e7e9ba7984c tempest-TestShelveInstance-1172287496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:04 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b9456bd5-8e31-40c4-85f7-eaf1e978c016 tempest-TestStampPattern-753289935 None] Create snapshot completed successfully Aug 26 12:14:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-9594e8ef-81f2-46b0-b525-a77b55b9436b req-8c7a587b-04d3-455e-84d0-3e7e9ba7984c tempest-TestShelveInstance-1172287496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8595d789-baf5-46ba-98dc-ed7204798f68', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:14:04 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-9594e8ef-81f2-46b0-b525-a77b55b9436b req-8c7a587b-04d3-455e-84d0-3e7e9ba7984c tempest-TestShelveInstance-1172287496 None] attachment_update completed successfully. Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:10 devstack sudo[110568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:14:10 devstack sudo[110568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:10 devstack sudo[110568]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.418s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:14:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (41c3582f-c2da-45c9-bf94-d70db2476391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d222ae-4db8-45be-b671-34dfbb9c3f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d222ae-4db8-45be-b671-34dfbb9c3f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-788116484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f870e0-a42f-4988-989a-08a0d5de9f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:13Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136bea17-cab4-490b-807e-3bffffb2cd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136bea17-cab4-490b-807e-3bffffb2cd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cebd43-a7c6-4fcd-ac8c-bd47a9934b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cebd43-a7c6-4fcd-ac8c-bd47a9934b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f870e0-a42f-4988-989a-08a0d5de9f6d', 'volume_name': 'volume-44f870e0-a42f-4988-989a-08a0d5de9f6d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd63f5-1136-4c39-91e3-bfb676a8c012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd63f5-1136-4c39-91e3-bfb676a8c012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23e6c59-c3d3-4441-9e27-963a7d3498fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:12 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume 44f870e0-a42f-4988-989a-08a0d5de9f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f870e0-a42f-4988-989a-08a0d5de9f6d', 'volume_size': 1} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-788116484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f870e0-a42f-4988-989a-08a0d5de9f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:13Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Creating volume 44f870e0-a42f-4988-989a-08a0d5de9f6d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:14:12 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:14:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:12 devstack sudo[110571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d 1073741824 Aug 26 12:14:12 devstack sudo[110571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:13 devstack sudo[110571]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d 1073741824" returned: 0 in 0.623s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:13 devstack sudo[110578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d Aug 26 12:14:13 devstack sudo[110578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:13 devstack sudo[110578]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d" returned: 0 in 0.382s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:14:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23e6c59-c3d3-4441-9e27-963a7d3498fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f870e0-a42f-4988-989a-08a0d5de9f6d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76b6976-6d4d-4bba-91dd-de1b73908097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:13 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume volume-44f870e0-a42f-4988-989a-08a0d5de9f6d (44f870e0-a42f-4988-989a-08a0d5de9f6d): created successfully Aug 26 12:14:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76b6976-6d4d-4bba-91dd-de1b73908097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (41c3582f-c2da-45c9-bf94-d70db2476391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-41ef238f-74b5-4d60-a83f-6890f39be2c6 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created volume successfully. Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (a4e1574d-63c1-4a46-ac07-e388424824a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f71870-8f6c-4978-85d9-b4ea13be9c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f71870-8f6c-4978-85d9-b4ea13be9c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093743517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:15Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1fa031-f1ff-4553-9b30-7072830d0af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1fa031-f1ff-4553-9b30-7072830d0af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f966cd-8c46-4109-afa1-9850915e16d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f966cd-8c46-4109-afa1-9850915e16d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370', 'volume_name': 'volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2bcf69-1717-437e-b1cd-0ce5db92488e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2bcf69-1717-437e-b1cd-0ce5db92488e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb62fb05-025c-4428-86fd-b484fee92146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:15 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume 9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370', 'volume_size': 1} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093743517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:15Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Creating volume 9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:14:15 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:15 devstack sudo[110583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 1073741824 Aug 26 12:14:15 devstack sudo[110583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:14:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Flow 'volume_create_manager' (cab112c7-de7a-4542-acee-82c4e5d0ecc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8667c6d-429d-4fee-ade7-bf822dfdacdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8667c6d-429d-4fee-ade7-bf822dfdacdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-777737805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acef6584b1d0414f8b905d9529df952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70fa28b4-49d6-453f-9a97-32afd58d819b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:16Z,use_quota=True,user_id='3bc510c296a840d5aa76f2558f7113bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622ac0d6-cfb2-4e3a-988f-7ef07e0ce46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622ac0d6-cfb2-4e3a-988f-7ef07e0ce46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70a0a5f-f8d0-4fbf-9caf-944b09635ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70a0a5f-f8d0-4fbf-9caf-944b09635ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0', 'volume_name': 'volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0', 'volume_size': 1, 'snapshot_id': '70fa28b4-49d6-453f-9a97-32afd58d819b'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460718e1-f4dc-4c55-8b47-e09543708962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460718e1-f4dc-4c55-8b47-e09543708962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309cc195-c9b4-44a6-9b81-0eabcd4f831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Volume 53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0', 'volume_size': 1, 'snapshot_id': '70fa28b4-49d6-453f-9a97-32afd58d819b'} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (7da72c7e-520c-4897-864e-50ee8254afca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddeca4d4-971a-414b-b0b4-f396e04d20ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddeca4d4-971a-414b-b0b4-f396e04d20ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892395358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522781a9-4ae4-4605-9bb8-d7460256e2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:17Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78148c4-9bdf-4f8d-bf28-b1a3c49b631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78148c4-9bdf-4f8d-bf28-b1a3c49b631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bca3f25-5fab-4c02-b4b6-8ff1c1cf1dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bca3f25-5fab-4c02-b4b6-8ff1c1cf1dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522781a9-4ae4-4605-9bb8-d7460256e2ec', 'volume_name': 'volume-522781a9-4ae4-4605-9bb8-d7460256e2ec', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:16 devstack sudo[110583]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecd939b-56dc-401a-8d79-4e9c9cfa6051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecd939b-56dc-401a-8d79-4e9c9cfa6051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d463aa9-8141-4fad-ab34-5b0941744f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:16 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume 522781a9-4ae4-4605-9bb8-d7460256e2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522781a9-4ae4-4605-9bb8-d7460256e2ec', 'volume_size': 1} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 1073741824" returned: 0 in 1.006s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:16 devstack sudo[110589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 Aug 26 12:14:16 devstack sudo[110589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:17 devstack sudo[110589]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370" returned: 0 in 0.538s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.287s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Acquiring lock "cinder-quobyte-70fa28b4-49d6-453f-9a97-32afd58d819b-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" by "_create_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (99f73764-6d87-41f4-9523-19344b5514c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb31e8db-1c25-47b9-a19f-633334f0c5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb62fb05-025c-4428-86fd-b484fee92146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f4b63a-5396-4355-8121-4caf4e04c2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb31e8db-1c25-47b9-a19f-633334f0c5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098224769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdfb177-fd36-4f29-8e1e-c7cc862f26ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:17Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18e1f9c-3f25-4db0-903b-e1832bef9585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18e1f9c-3f25-4db0-903b-e1832bef9585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a260932-5558-4306-9e6d-8c65f1c21edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a260932-5558-4306-9e6d-8c65f1c21edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bdfb177-fd36-4f29-8e1e-c7cc862f26ed', 'volume_name': 'volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e4de6b-039d-46a6-975f-a318d22ae9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e4de6b-039d-46a6-975f-a318d22ae9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e15bf4-4543-4120-86d5-21d7fd5be267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume 4bdfb177-fd36-4f29-8e1e-c7cc862f26ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed', 'volume_size': 1} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-70fa28b4-49d6-453f-9a97-32afd58d819b-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" acquired by "_create_volume_from_snapshot" :: waited 0.268s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Creating volume 53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 from snapshot 70fa28b4-49d6-453f-9a97-32afd58d819b {{(pid=94387) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Acquiring lock "cinder-quobyte-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 (9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370): created successfully Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f4b63a-5396-4355-8121-4caf4e04c2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (a4e1574d-63c1-4a46-ac07-e388424824a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" acquired by "_copy_volume_from_snapshot" :: waited 0.067s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] snapshot: 70fa28b4-49d6-453f-9a97-32afd58d819b, volume: 53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:17 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5fbceb3a-c812-440a-88a8-74978883ab33 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created volume successfully. Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8df6d2-27a3-44a7-9c6c-589976d68245]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:18 devstack sudo[110595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b Aug 26 12:14:18 devstack sudo[110595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (0ac1bbf2-85fb-44c6-8712-df3ef93f7d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be2c355-a719-4bb0-be85-b09342c35f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be2c355-a719-4bb0-be85-b09342c35f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226549734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c63928-d0b0-4014-9db1-33965c2bf5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:18Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70409de-2609-40a3-b261-d32aaa4947fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70409de-2609-40a3-b261-d32aaa4947fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69939c04-622c-4fe3-953e-7184354ed762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69939c04-622c-4fe3-953e-7184354ed762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c63928-d0b0-4014-9db1-33965c2bf5bf', 'volume_name': 'volume-73c63928-d0b0-4014-9db1-33965c2bf5bf', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4ba2b3-af3c-4979-9c1f-0005eccfa86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4ba2b3-af3c-4979-9c1f-0005eccfa86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1a4c88-5203-45a6-942a-0db9a77d4b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume 73c63928-d0b0-4014-9db1-33965c2bf5bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c63928-d0b0-4014-9db1-33965c2bf5bf', 'volume_size': 1} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:18 devstack sudo[110595]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b" returned: 0 in 0.570s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f393dd-ac9f-4def-890e-3f1f041b4343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[af57963b-8b81-4b86-95c5-52edef26f59c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:18 devstack sudo[110600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 Aug 26 12:14:18 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (ac530987-954e-43da-bc54-9204d06fab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41444c4-23e3-45f5-a167-fb63b064c7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41444c4-23e3-45f5-a167-fb63b064c7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008972623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77b0680-3e26-480e-b7a5-0db7381d960d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:19Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed023d84-b801-4a50-b841-ae99ef097b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed023d84-b801-4a50-b841-ae99ef097b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31c1192-0b72-4b4d-a163-bf295ce7379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31c1192-0b72-4b4d-a163-bf295ce7379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77b0680-3e26-480e-b7a5-0db7381d960d', 'volume_name': 'volume-a77b0680-3e26-480e-b7a5-0db7381d960d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2cd3b9-ce43-4ba5-89fa-a26cb8e00ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2cd3b9-ce43-4ba5-89fa-a26cb8e00ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f65f2a-fe8c-4a77-91f3-cc37fe5472df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:18 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume a77b0680-3e26-480e-b7a5-0db7381d960d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77b0680-3e26-480e-b7a5-0db7381d960d', 'volume_size': 1} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:18 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343" returned: 0 in 0.465s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:14:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:19 devstack sudo[110606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 Aug 26 12:14:19 devstack sudo[110606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:25 devstack sudo[110606]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" returned: 0 in 7.005s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:25 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:14:25 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Converted 1024.00 MB image at 146.05 MB/s Aug 26 12:14:25 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 is being set with open permissions: ugo+rw Aug 26 12:14:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:26 devstack sudo[110657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 Aug 26 12:14:26 devstack sudo[110657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:26 devstack sudo[110657]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" returned: 0 in 0.455s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" released by "_copy_volume_from_snapshot" :: held 8.671s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-70fa28b4-49d6-453f-9a97-32afd58d819b-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" released by "_create_volume_from_snapshot" :: held 8.828s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.100s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.771s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892395358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522781a9-4ae4-4605-9bb8-d7460256e2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:17Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Creating volume 522781a9-4ae4-4605-9bb8-d7460256e2ec {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:14:26 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309cc195-c9b4-44a6-9b81-0eabcd4f831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0', 'volume_size': 1, 'snapshot_id': '70fa28b4-49d6-453f-9a97-32afd58d819b'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09267cae-fc7c-4ee1-bfda-3d3746dde966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:26 devstack sudo[110673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec 1073741824 Aug 26 12:14:26 devstack sudo[110673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:26 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Volume volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 (53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0): created successfully Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09267cae-fc7c-4ee1-bfda-3d3746dde966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Flow 'volume_create_manager' (cab112c7-de7a-4542-acee-82c4e5d0ecc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:26 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2a63523e-b092-4ade-ab9b-9b6096622594 tempest-TestStampPattern-753289935 None] Created volume successfully. Aug 26 12:14:27 devstack sudo[110673]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec 1073741824" returned: 0 in 0.663s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:27 devstack sudo[110684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec Aug 26 12:14:27 devstack sudo[110684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:27 devstack sudo[110684]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec" returned: 0 in 0.410s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.974s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098224769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdfb177-fd36-4f29-8e1e-c7cc862f26ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:17Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Creating volume 4bdfb177-fd36-4f29-8e1e-c7cc862f26ed {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:14:27 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:27 devstack sudo[110702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed 1073741824 Aug 26 12:14:27 devstack sudo[110702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d463aa9-8141-4fad-ab34-5b0941744f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522781a9-4ae4-4605-9bb8-d7460256e2ec', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5297f63b-4b79-4a99-a985-596fa45a966c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:27 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume volume-522781a9-4ae4-4605-9bb8-d7460256e2ec (522781a9-4ae4-4605-9bb8-d7460256e2ec): created successfully Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5297f63b-4b79-4a99-a985-596fa45a966c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (7da72c7e-520c-4897-864e-50ee8254afca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-08d6d8a8-8b09-4284-a777-a112dd9a531b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created volume successfully. Aug 26 12:14:28 devstack sudo[110702]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed 1073741824" returned: 0 in 0.799s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:28 devstack sudo[110731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed Aug 26 12:14:28 devstack sudo[110731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:28 devstack sudo[110731]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed" returned: 0 in 0.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.607s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226549734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c63928-d0b0-4014-9db1-33965c2bf5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:18Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Creating volume 73c63928-d0b0-4014-9db1-33965c2bf5bf {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:14:28 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e15bf4-4543-4120-86d5-21d7fd5be267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:28 devstack sudo[110755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf 1073741824 Aug 26 12:14:28 devstack sudo[110755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2428af-0d79-4408-a46b-2824bb6a2c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:28 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed (4bdfb177-fd36-4f29-8e1e-c7cc862f26ed): created successfully Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2428af-0d79-4408-a46b-2824bb6a2c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (99f73764-6d87-41f4-9523-19344b5514c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-522b7db0-eba7-4cec-83d5-823ea349b621 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created volume successfully. Aug 26 12:14:29 devstack sudo[110755]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf 1073741824" returned: 0 in 0.586s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:29 devstack sudo[110773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf Aug 26 12:14:29 devstack sudo[110773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:29 devstack sudo[110773]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf" returned: 0 in 0.252s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.831s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008972623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77b0680-3e26-480e-b7a5-0db7381d960d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdebba76a954a4282e9a666c57160ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:19Z,use_quota=True,user_id='05003bbb78954986ad7c200b26a46216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Creating volume a77b0680-3e26-480e-b7a5-0db7381d960d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:14:29 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1a4c88-5203-45a6-942a-0db9a77d4b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c63928-d0b0-4014-9db1-33965c2bf5bf', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:29 devstack sudo[110776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d 1073741824 Aug 26 12:14:29 devstack sudo[110776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210b2572-06f0-47f4-bf5d-1b4121e72452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:29 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume volume-73c63928-d0b0-4014-9db1-33965c2bf5bf (73c63928-d0b0-4014-9db1-33965c2bf5bf): created successfully Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210b2572-06f0-47f4-bf5d-1b4121e72452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (0ac1bbf2-85fb-44c6-8712-df3ef93f7d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:29 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b57fb41f-1e54-4d7d-861a-b2b5ae2a4a75 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created volume successfully. Aug 26 12:14:30 devstack sudo[110776]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d 1073741824" returned: 0 in 0.574s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:30 devstack sudo[110784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d Aug 26 12:14:30 devstack sudo[110784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:30 devstack sudo[110784]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d" returned: 0 in 0.315s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:14:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f65f2a-fe8c-4a77-91f3-cc37fe5472df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77b0680-3e26-480e-b7a5-0db7381d960d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc1ccaa-68b0-48b3-a210-3d2a77ea66c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:30 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Volume volume-a77b0680-3e26-480e-b7a5-0db7381d960d (a77b0680-3e26-480e-b7a5-0db7381d960d): created successfully Aug 26 12:14:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc1ccaa-68b0-48b3-a210-3d2a77ea66c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Flow 'volume_create_manager' (ac530987-954e-43da-bc54-9204d06fab48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2a04d1ea-9369-4ffc-8f2d-1562491c2a9f tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created volume successfully. Aug 26 12:14:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-a77b0680-3e26-480e-b7a5-0db7381d960d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-a77b0680-3e26-480e-b7a5-0db7381d960d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-quobyte-a77b0680-3e26-480e-b7a5-0db7381d960d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:31 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-a77b0680-3e26-480e-b7a5-0db7381d960d" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:31 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb6eda-f5dc-47b6-afe2-0fb55369991d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:32 devstack sudo[110821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d Aug 26 12:14:32 devstack sudo[110821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:32 devstack sudo[110821]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d" returned: 0 in 0.471s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:32 devstack sudo[110828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d Aug 26 12:14:32 devstack sudo[110828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:32 devstack sudo[110828]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a77b0680-3e26-480e-b7a5-0db7381d960d" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-a77b0680-3e26-480e-b7a5-0db7381d960d" released by "delete_volume" :: held 0.865s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created reservations ['eb61c3ec-55bf-43e8-a3c8-8ad673754161', 'f3b1bb74-e868-4485-a4f9-e360159ee7bf', '3494e629-c9e5-4e16-adaa-523e39fdaff8', '3365a6ca-b8bd-4a21-ac11-2706b6ed46d9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:32 devstack sudo[110832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:14:32 devstack sudo[110832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:33 devstack sudo[110832]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.288s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:33 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:14:33 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Deleted volume successfully. Aug 26 12:14:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d2f8ae07-0360-4dc3-8539-720a592fe958 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-a77b0680-3e26-480e-b7a5-0db7381d960d-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-73c63928-d0b0-4014-9db1-33965c2bf5bf-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-73c63928-d0b0-4014-9db1-33965c2bf5bf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-quobyte-73c63928-d0b0-4014-9db1-33965c2bf5bf" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-73c63928-d0b0-4014-9db1-33965c2bf5bf" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[06239757-4e83-41bd-b962-352a2d2940f6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:34 devstack sudo[110836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf Aug 26 12:14:34 devstack sudo[110836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:34 devstack sudo[110836]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf" returned: 0 in 0.422s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:34 devstack sudo[110841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf Aug 26 12:14:34 devstack sudo[110841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:34 devstack sudo[110841]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-73c63928-d0b0-4014-9db1-33965c2bf5bf" returned: 0 in 0.264s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-73c63928-d0b0-4014-9db1-33965c2bf5bf" released by "delete_volume" :: held 0.730s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created reservations ['5110243c-72e5-4ad1-b601-39fdbf30e482', '3a8486ef-dc0e-499e-9cd8-c8fd4fc9fc6c', 'a191348d-a6ff-4069-852b-e21f68f1a280', 'fc51af8c-a263-47bb-a827-d1a0dbb880e2'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:35 devstack sudo[110844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:14:35 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-quobyte-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:35 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c278c872-eace-4c97-b5ef-96ae4fef1bf3]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.419s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:14:35 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Deleted volume successfully. Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9d6f1ded-7b04-42f2-ace0-27c7e91c4b2a tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-73c63928-d0b0-4014-9db1-33965c2bf5bf-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:35 devstack sudo[110847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed Aug 26 12:14:35 devstack sudo[110847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:35 devstack sudo[110847]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed" returned: 0 in 0.470s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:35 devstack sudo[110857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed Aug 26 12:14:35 devstack sudo[110857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:36 devstack sudo[110857]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed" returned: 0 in 0.317s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed" released by "delete_volume" :: held 0.836s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created reservations ['7bf8292c-4429-4813-8a18-73e4369a96c6', '108a397d-8910-4c09-808b-47a808d564f4', 'd69803af-e3a4-4055-94a2-bbf95cb42590', '48cba79e-e197-4431-85a6-d89d40652438'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:36 devstack sudo[110867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:14:36 devstack sudo[110867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-522781a9-4ae4-4605-9bb8-d7460256e2ec-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-522781a9-4ae4-4605-9bb8-d7460256e2ec-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-quobyte-522781a9-4ae4-4605-9bb8-d7460256e2ec" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-522781a9-4ae4-4605-9bb8-d7460256e2ec" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2385ef96-e16b-45f1-ad49-1262701954e6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:36 devstack sudo[110867]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.574s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:14:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Deleted volume successfully. Aug 26 12:14:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-510ef23f-259e-4b85-8b7c-addf13b30a2b tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-4bdfb177-fd36-4f29-8e1e-c7cc862f26ed-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:37 devstack sudo[110871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec Aug 26 12:14:37 devstack sudo[110871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:37 devstack sudo[110871]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec" returned: 0 in 0.533s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:37 devstack sudo[110882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec Aug 26 12:14:37 devstack sudo[110882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:37 devstack sudo[110882]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-522781a9-4ae4-4605-9bb8-d7460256e2ec" returned: 0 in 0.302s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-522781a9-4ae4-4605-9bb8-d7460256e2ec" released by "delete_volume" :: held 0.884s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created reservations ['1d787af3-cec4-4966-b33d-a75e3bf0ad92', '9d4121bc-6ce0-4e56-97a9-05e144cfdf80', '8239c3f5-4f6f-4be5-a84f-fecb052244f1', '71a30cd4-b418-473b-b681-c01d705438f2'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:37 devstack sudo[110885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:14:37 devstack sudo[110885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:38 devstack sudo[110885]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.303s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:38 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:14:38 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Deleted volume successfully. Aug 26 12:14:38 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c81158a6-a74e-4628-b256-6c8774d26c34 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-522781a9-4ae4-4605-9bb8-d7460256e2ec-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-quobyte-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d4f5e-f15f-4c6c-8744-15791f226e43]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:39 devstack sudo[110913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 Aug 26 12:14:39 devstack sudo[110913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-bd78865a-73bc-4552-87ba-ae8f52f579bf req-39bf85e0-805a-4544-8919-6f5151fdb2ed tempest-TestShelveInstance-1172287496 None] Terminate volume connection completed successfully. Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-bd78865a-73bc-4552-87ba-ae8f52f579bf req-39bf85e0-805a-4544-8919-6f5151fdb2ed tempest-TestShelveInstance-1172287496 None] Deleting attachment 8595d789-baf5-46ba-98dc-ed7204798f68. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:14:39 devstack sudo[110913]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370" returned: 0 in 0.448s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:39 devstack sudo[110918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370 Aug 26 12:14:39 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:39 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:39 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370" released by "delete_volume" :: held 0.805s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created reservations ['3ef4d36c-f3c7-4772-a6be-1202d4baa82f', '780feb22-5b75-4c4c-8b86-61130f6faf14', 'f874c7ba-918b-4664-976a-64be41cd2b75', 'eb0d5a2b-fe3d-4151-a5fd-d285b616d45f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:40 devstack sudo[110921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:14:40 devstack sudo[110921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-44f870e0-a42f-4988-989a-08a0d5de9f6d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-44f870e0-a42f-4988-989a-08a0d5de9f6d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "cinder-quobyte-44f870e0-a42f-4988-989a-08a0d5de9f6d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-44f870e0-a42f-4988-989a-08a0d5de9f6d" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:40 devstack sudo[110921]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.276s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:14:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Deleted volume successfully. Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[334340dd-98a4-4d5e-884c-94cef674bdc4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d8d7cb16-e9c9-47c9-82f8-01924128cd62 tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-9be34e63-bdfa-4ac1-ad6e-9d8ef01ab370-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:40 devstack sudo[110924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d Aug 26 12:14:40 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:40 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d" returned: 0 in 0.400s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:40 devstack sudo[110929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d Aug 26 12:14:40 devstack sudo[110929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:41 devstack sudo[110929]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-44f870e0-a42f-4988-989a-08a0d5de9f6d" returned: 0 in 0.269s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-quobyte-44f870e0-a42f-4988-989a-08a0d5de9f6d" released by "delete_volume" :: held 0.723s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Created reservations ['679f358f-e774-40d1-8b60-55b0e4f4bda4', '60ff7c15-7dfa-4039-93b0-381e2ebbc3e4', '5ce52791-b4ee-49dd-a4d1-383b37a616d6', '89697fa9-aa7b-47f2-a76c-a1d4ce2e52e3'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:41 devstack sudo[110934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:14:41 devstack sudo[110934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:41 devstack sudo[110934]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.349s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:14:41 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Deleted volume successfully. Aug 26 12:14:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f06d2240-4aa1-4384-81c1-426b5a2195aa tempest-CreateVolumesFromSourceVolumeTest-794454290 None] Lock "cinder-44f870e0-a42f-4988-989a-08a0d5de9f6d-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-ba3bdb0a-29c7-4503-a889-b84bf651e25e req-4897dcef-7477-482f-a837-a9042f32e2ae tempest-TestShelveInstance-1172287496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-ba3bdb0a-29c7-4503-a889-b84bf651e25e req-4897dcef-7477-482f-a837-a9042f32e2ae tempest-TestShelveInstance-1172287496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-ba3bdb0a-29c7-4503-a889-b84bf651e25e req-4897dcef-7477-482f-a837-a9042f32e2ae tempest-TestShelveInstance-1172287496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-ba3bdb0a-29c7-4503-a889-b84bf651e25e req-4897dcef-7477-482f-a837-a9042f32e2ae tempest-TestShelveInstance-1172287496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f52105db-f2ba-40c5-a240-1e6d62bbc56f', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:14:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-ba3bdb0a-29c7-4503-a889-b84bf651e25e req-4897dcef-7477-482f-a837-a9042f32e2ae tempest-TestShelveInstance-1172287496 None] attachment_update completed successfully. Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Flow 'volume_create_manager' (81e3dd17-ec9e-479d-b145-09e6546e10ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c69cbac-a807-4a9c-a84a-36b233a42682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c69cbac-a807-4a9c-a84a-36b233a42682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2079869164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce6c8ca-5ab9-40ce-8032-7bbe310177c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4689768b074ef7847c5490042a193c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:45Z,use_quota=True,user_id='4f6bf8a64ac44c768256281946f5fcce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2558e7eb-edc9-49d3-8374-7ba2db958d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2558e7eb-edc9-49d3-8374-7ba2db958d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5494fc6d-7cff-41ad-a06a-31a370a1a188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5494fc6d-7cff-41ad-a06a-31a370a1a188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce6c8ca-5ab9-40ce-8032-7bbe310177c1', 'volume_name': 'volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb9fbe3-25c3-41b5-ba2c-82bff43024af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb9fbe3-25c3-41b5-ba2c-82bff43024af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b722b2-c654-4a32-9e0f-6c26c9877374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:44 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Volume 2ce6c8ca-5ab9-40ce-8032-7bbe310177c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1', 'volume_size': 1} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2079869164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce6c8ca-5ab9-40ce-8032-7bbe310177c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4689768b074ef7847c5490042a193c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:45Z,use_quota=True,user_id='4f6bf8a64ac44c768256281946f5fcce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Creating volume 2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:14:44 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:14:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:44 devstack sudo[110958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 1073741824 Aug 26 12:14:44 devstack sudo[110958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:45 devstack sudo[110958]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 1073741824" returned: 0 in 0.484s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:45 devstack sudo[110965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 Aug 26 12:14:45 devstack sudo[110965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:45 devstack sudo[110965]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" returned: 0 in 0.267s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:14:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b722b2-c654-4a32-9e0f-6c26c9877374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7591a9-a3e8-445b-b7b8-cf084b3d9b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:45 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Volume volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 (2ce6c8ca-5ab9-40ce-8032-7bbe310177c1): created successfully Aug 26 12:14:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7591a9-a3e8-445b-b7b8-cf084b3d9b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Flow 'volume_create_manager' (81e3dd17-ec9e-479d-b145-09e6546e10ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:45 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-049105e6-7c70-4463-aefe-1c1f47c9e1bb tempest-VolumeDependencyTests-225153178 None] Created volume successfully. Aug 26 12:14:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Creating offline snapshot b62d93af-7b68-4a0b-a026-4e2b0ac902b8 of volume 2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:14:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0330f7-346a-42f2-9744-38596ac0c468]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:47 devstack sudo[111396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 Aug 26 12:14:47 devstack sudo[111396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:47 devstack sudo[111396]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" returned: 0 in 0.483s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:47 devstack sudo[111417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 1G Aug 26 12:14:47 devstack sudo[111417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:48 devstack sudo[111417]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 1G" returned: 0 in 0.447s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:48 devstack sudo[111439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 Aug 26 12:14:48 devstack sudo[111439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:48 devstack sudo[111439]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8" returned: 0 in 0.323s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:48 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 is being set with open permissions: ugo+rw Aug 26 12:14:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:48 devstack sudo[111444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 Aug 26 12:14:48 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:48 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8" returned: 0 in 0.244s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:48 devstack sudo[111447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.info Aug 26 12:14:48 devstack sudo[111447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:49 devstack sudo[111447]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.info" returned: 0 in 0.270s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:49 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.info is being set with open permissions: ugo+rw Aug 26 12:14:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:49 devstack sudo[111452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.info Aug 26 12:14:49 devstack sudo[111452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:49 devstack sudo[111452]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.info" returned: 0 in 0.313s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.208s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-73d4dc14-202e-493f-b9bc-8c365b6da7e3 tempest-VolumeDependencyTests-225153178 None] Create snapshot completed successfully Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=84,cinder:UPDATE=102,cinder:INSERT=21,cinder:DELETE=7 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=93,cinder:UPDATE=83,cinder:INSERT=30,cinder:DELETE=11 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Flow 'volume_create_manager' (428a052e-43b3-45bb-8f83-efe3e58933de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef6189d-b335-4179-a163-f8e7c6974122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef6189d-b335-4179-a163-f8e7c6974122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-374705686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a4ddc3-c410-42d7-93ca-34529f18b13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4689768b074ef7847c5490042a193c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b62d93af-7b68-4a0b-a026-4e2b0ac902b8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:14:51Z,use_quota=True,user_id='4f6bf8a64ac44c768256281946f5fcce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf07597a-c65b-4994-9ba7-890839d34a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf07597a-c65b-4994-9ba7-890839d34a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7337788b-2dab-4ae8-ac93-675f241e3935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7337788b-2dab-4ae8-ac93-675f241e3935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75a4ddc3-c410-42d7-93ca-34529f18b13e', 'volume_name': 'volume-75a4ddc3-c410-42d7-93ca-34529f18b13e', 'volume_size': 1, 'snapshot_id': 'b62d93af-7b68-4a0b-a026-4e2b0ac902b8'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7e013c-432d-40fd-a87a-a1b6bba36977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7e013c-432d-40fd-a87a-a1b6bba36977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc871da-87c4-4069-b71a-d0832f4051f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:51 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Volume 75a4ddc3-c410-42d7-93ca-34529f18b13e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75a4ddc3-c410-42d7-93ca-34529f18b13e', 'volume_size': 1, 'snapshot_id': 'b62d93af-7b68-4a0b-a026-4e2b0ac902b8'} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "cinder-quobyte-b62d93af-7b68-4a0b-a026-4e2b0ac902b8-75a4ddc3-c410-42d7-93ca-34529f18b13e" by "_create_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-b62d93af-7b68-4a0b-a026-4e2b0ac902b8-75a4ddc3-c410-42d7-93ca-34529f18b13e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Creating volume 75a4ddc3-c410-42d7-93ca-34529f18b13e from snapshot b62d93af-7b68-4a0b-a026-4e2b0ac902b8 {{(pid=94387) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "cinder-quobyte-75a4ddc3-c410-42d7-93ca-34529f18b13e" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-75a4ddc3-c410-42d7-93ca-34529f18b13e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] snapshot: b62d93af-7b68-4a0b-a026-4e2b0ac902b8, volume: 75a4ddc3-c410-42d7-93ca-34529f18b13e, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9e6fe4-1249-4e6d-aea4-4f9a94e999ec]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:51 devstack sudo[111456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 Aug 26 12:14:51 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:51 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8" returned: 0 in 0.408s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[11578e7b-03e4-4b62-9586-a96dcc654e41]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:51 devstack sudo[111461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 Aug 26 12:14:51 devstack sudo[111461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:52 devstack sudo[111461]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" returned: 0 in 0.410s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:14:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:14:52 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:14:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:52 devstack sudo[111466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e Aug 26 12:14:52 devstack sudo[111466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:57 devstack sudo[111466]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e" returned: 0 in 5.785s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:57 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:14:57 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Converted 1024.00 MB image at 176.97 MB/s Aug 26 12:14:57 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e is being set with open permissions: ugo+rw Aug 26 12:14:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:57 devstack sudo[111480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e Aug 26 12:14:57 devstack sudo[111480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:58 devstack sudo[111480]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e" returned: 0 in 0.250s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-75a4ddc3-c410-42d7-93ca-34529f18b13e" released by "_copy_volume_from_snapshot" :: held 6.940s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-b62d93af-7b68-4a0b-a026-4e2b0ac902b8-75a4ddc3-c410-42d7-93ca-34529f18b13e" released by "_create_volume_from_snapshot" :: held 7.014s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:14:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.034s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:14:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc871da-87c4-4069-b71a-d0832f4051f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a4ddc3-c410-42d7-93ca-34529f18b13e', 'volume_size': 1, 'snapshot_id': 'b62d93af-7b68-4a0b-a026-4e2b0ac902b8'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67bb906-374d-4eb3-ac2c-8f65818ae774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:14:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Volume volume-75a4ddc3-c410-42d7-93ca-34529f18b13e (75a4ddc3-c410-42d7-93ca-34529f18b13e): created successfully Aug 26 12:14:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67bb906-374d-4eb3-ac2c-8f65818ae774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:14:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Flow 'volume_create_manager' (428a052e-43b3-45bb-8f83-efe3e58933de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:14:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c674a725-19ca-46c4-8615-9a2c27278573 tempest-VolumeDependencyTests-225153178 None] Created volume successfully. Aug 26 12:14:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Acquiring lock "cinder-b62d93af-7b68-4a0b-a026-4e2b0ac902b8-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Lock "cinder-b62d93af-7b68-4a0b-a026-4e2b0ac902b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Acquiring lock "cinder-quobyte-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Acquiring lock "cinder-quobyte-b62d93af-7b68-4a0b-a026-4e2b0ac902b8" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-b62d93af-7b68-4a0b-a026-4e2b0ac902b8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Deleting offline snapshot b62d93af-7b68-4a0b-a026-4e2b0ac902b8 of volume 2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] snapshot_file for this snap is: volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a99d533-4200-4a39-9abd-2298c7bd5cd0]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:59 devstack sudo[111483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 Aug 26 12:14:59 devstack sudo[111483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:14:59 devstack sudo[111483]: pam_unix(sudo:session): session closed for user root Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8" returned: 0 in 0.383s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c6f46e-7d1e-4d83-98af-9bdded7b42d7]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:14:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:14:59 devstack sudo[111488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 Aug 26 12:14:59 devstack sudo[111488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:00 devstack sudo[111488]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" returned: 0 in 0.575s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:00 devstack sudo[111495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 Aug 26 12:15:00 devstack sudo[111495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:00 devstack sudo[111495]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8" returned: 0 in 0.365s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:00 devstack sudo[111508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8 Aug 26 12:15:00 devstack sudo[111508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:00 devstack sudo[111508]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1.b62d93af-7b68-4a0b-a026-4e2b0ac902b8" returned: 0 in 0.260s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-b62d93af-7b68-4a0b-a026-4e2b0ac902b8" released by "_delete_snapshot" :: held 1.706s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" released by "delete_snapshot" :: held 1.731s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:00 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Created reservations ['2c18d1e0-4f3c-4475-882b-58fba4b81ee7', '47275de0-cd3a-4406-9f8c-2d5cbcef2ba8', 'a8bcaabb-6d8f-4b3a-94dd-4c4137ec205b', '165a5248-1baa-4460-bb6f-638a1f7cd7e9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Delete snapshot completed successfully. Aug 26 12:15:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8eae8ae0-ce1d-4b79-aa32-0dde4c6f6fbf tempest-VolumeDependencyTests-225153178 None] Lock "cinder-b62d93af-7b68-4a0b-a026-4e2b0ac902b8-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "cinder-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "cinder-quobyte-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" acquired by "delete_volume" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee55ad0-14d2-4f34-956f-64c28b12561c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:01 devstack sudo[111520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 Aug 26 12:15:01 devstack sudo[111520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:01 devstack sudo[111520]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" returned: 0 in 0.382s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:01 devstack sudo[111525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1 Aug 26 12:15:01 devstack sudo[111525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:01 devstack sudo[111525]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" returned: 0 in 0.255s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1" released by "delete_volume" :: held 0.705s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Created reservations ['6d41c243-cf29-40ec-ac0f-6bb4e535139b', 'e3dc595b-dbc8-451b-9748-aa7d69a3aa2f', '119e47e2-bd94-4851-967b-991ed8358fb9', '1f665966-b13f-47a8-9ab9-feaf219267fc'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:02 devstack sudo[111528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:02 devstack sudo[111528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:02 devstack sudo[111528]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.269s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Deleted volume successfully. Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "cinder-75a4ddc3-c410-42d7-93ca-34529f18b13e-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-04112203-13a0-40da-a820-f7e1488de162 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-2ce6c8ca-5ab9-40ce-8032-7bbe310177c1-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-75a4ddc3-c410-42d7-93ca-34529f18b13e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "cinder-quobyte-75a4ddc3-c410-42d7-93ca-34529f18b13e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-75a4ddc3-c410-42d7-93ca-34529f18b13e" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e34e68-4afa-48c0-85c1-5c5d300331b9]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:02 devstack sudo[111531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e Aug 26 12:15:02 devstack sudo[111531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:02 devstack sudo[111531]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e" returned: 0 in 0.369s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:02 devstack sudo[111536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e Aug 26 12:15:02 devstack sudo[111536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:03 devstack sudo[111536]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-75a4ddc3-c410-42d7-93ca-34529f18b13e" returned: 0 in 0.255s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-quobyte-75a4ddc3-c410-42d7-93ca-34529f18b13e" released by "delete_volume" :: held 0.677s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Created reservations ['5f251573-3ce4-40ee-a81a-aada125ebae9', '95365bad-1bd8-41e5-90fa-e0b8c2227c3f', '69f2f23c-6708-4a9c-9dc0-40a9e60a48d6', 'a7cf085e-fe36-4369-b93d-eb7d5827326c'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:03 devstack sudo[111539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:03 devstack sudo[111539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:03 devstack sudo[111539]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.278s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:03 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Deleted volume successfully. Aug 26 12:15:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a9d8c6ed-193c-41a2-8941-4889af42b5a5 tempest-VolumeDependencyTests-225153178 None] Lock "cinder-75a4ddc3-c410-42d7-93ca-34529f18b13e-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Flow 'volume_create_manager' (df0b8fde-c47d-4086-ba0a-3cfc69fcbd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f2dd1c-91c0-4180-b79a-8ca090f87eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f2dd1c-91c0-4180-b79a-8ca090f87eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc6102d2eaf4a339fcf3c5daeef294d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:09Z,use_quota=True,user_id='7499635d05f4480fb180bdade63dbf61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8194b0-0ece-4cea-a7ba-73d52e81b899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8194b0-0ece-4cea-a7ba-73d52e81b899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9341c064-07a4-49c8-a823-cb72ccc46778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9341c064-07a4-49c8-a823-cb72ccc46778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4', 'volume_name': 'volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4', 'volume_size': 1, 'image_id': '23e50588-0b31-49b7-9ab0-587f6f7113ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e50588-0b31-49b7-9ab0-587f6f7113ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b0a8e92673d982c832633a699beb2a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'abc6102d2eaf4a339fcf3c5daeef294d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c34baa59f09c5297fe040411a95f3f3526496b93a1b979dec16620777eccab3e7f821926e2b61863bdfb6b259c0a8a1ac47c8811ec2a63caf14b6a88e4d39a6c', 'id': '23e50588-0b31-49b7-9ab0-587f6f7113ea', 'created_at': datetime.datetime(2026, 8, 26, 10, 15, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 15, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e50588-0b31-49b7-9ab0-587f6f7113ea/file', 'properties': {}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd74469-f70e-4d20-be40-7a53bdcc0165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd74469-f70e-4d20-be40-7a53bdcc0165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a1d237-c64b-4a90-b514-3f2bbed178d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:08 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Volume f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4', 'volume_size': 1, 'image_id': '23e50588-0b31-49b7-9ab0-587f6f7113ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e50588-0b31-49b7-9ab0-587f6f7113ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b0a8e92673d982c832633a699beb2a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'abc6102d2eaf4a339fcf3c5daeef294d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c34baa59f09c5297fe040411a95f3f3526496b93a1b979dec16620777eccab3e7f821926e2b61863bdfb6b259c0a8a1ac47c8811ec2a63caf14b6a88e4d39a6c', 'id': '23e50588-0b31-49b7-9ab0-587f6f7113ea', 'created_at': datetime.datetime(2026, 8, 26, 10, 15, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 15, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e50588-0b31-49b7-9ab0-587f6f7113ea/file', 'properties': {}}, 'image_service': } Aug 26 12:15:08 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Trying to clone f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 from image 23e50588-0b31-49b7-9ab0-587f6f7113ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/23e50588-0b31-49b7-9ab0-587f6f7113ea', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:15:09 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Image download 0.00 MB at 0.00 MB/s Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d50541-1eba-4617-a261-a953023e5635]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:09 devstack sudo[111575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD Aug 26 12:15:09 devstack sudo[111575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:09 devstack sudo[111575]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:09 devstack sudo[111581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD Aug 26 12:15:09 devstack sudo[111581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:09 devstack sudo[111581]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Temporary image 23e50588-0b31-49b7-9ab0-587f6f7113ea is fetched for user 7499635d05f4480fb180bdade63dbf61. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9779e1e-8dcc-454f-b13f-23ce1dc23aec]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:10 devstack sudo[111589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD Aug 26 12:15:10 devstack sudo[111589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-cc65a94c-2201-4bfa-89f8-14292ca9755f req-1efd41e7-b20e-4c2c-b94f-365bf084eee3 tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-cc65a94c-2201-4bfa-89f8-14292ca9755f req-1efd41e7-b20e-4c2c-b94f-365bf084eee3 tempest-TestStampPattern-753289935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-cc65a94c-2201-4bfa-89f8-14292ca9755f req-1efd41e7-b20e-4c2c-b94f-365bf084eee3 tempest-TestStampPattern-753289935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-cc65a94c-2201-4bfa-89f8-14292ca9755f req-1efd41e7-b20e-4c2c-b94f-365bf084eee3 tempest-TestStampPattern-753289935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d', 'name': 'volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14452bdc-69f4-4acf-ac62-147aa352fb47', 'enforce_multipath': True} {{(pid=94387) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 12:15:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-cc65a94c-2201-4bfa-89f8-14292ca9755f req-1efd41e7-b20e-4c2c-b94f-365bf084eee3 tempest-TestStampPattern-753289935 None] attachment_update completed successfully. Aug 26 12:15:10 devstack sudo[111589]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:10 devstack sudo[111601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD Aug 26 12:15:10 devstack sudo[111601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:10 devstack sudo[111601]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc6102d2eaf4a339fcf3c5daeef294d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:09Z,use_quota=True,user_id='7499635d05f4480fb180bdade63dbf61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Creating volume f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:15:10 devstack sudo[111611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:10 devstack sudo[111611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:15:10 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:10 devstack sudo[111613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 1073741824 Aug 26 12:15:10 devstack sudo[111613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:10 devstack sudo[111611]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.281s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:15:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:15:11 devstack sudo[111613]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 1073741824" returned: 0 in 0.551s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:11 devstack sudo[111626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 Aug 26 12:15:11 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:11 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4" returned: 0 in 0.246s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Attempting download of 23e50588-0b31-49b7-9ab0-587f6f7113ea ((None, [{'url': 'file:///opt/stack/data/glance/images/23e50588-0b31-49b7-9ab0-587f6f7113ea', 'metadata': {}}])) to volume f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73da6dc-695d-492b-8835-92b5af9cd103]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e50588-0b31-49b7-9ab0-587f6f7113ea_xpylotgl {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:11 devstack sudo[111635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e50588-0b31-49b7-9ab0-587f6f7113ea_xpylotgl Aug 26 12:15:11 devstack sudo[111635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:11 devstack sudo[111635]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e50588-0b31-49b7-9ab0-587f6f7113ea_xpylotgl" returned: 0 in 0.344s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e50588-0b31-49b7-9ab0-587f6f7113ea_xpylotgl {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:12 devstack sudo[111643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e50588-0b31-49b7-9ab0-587f6f7113ea_xpylotgl Aug 26 12:15:12 devstack sudo[111643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:12 devstack sudo[111643]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e50588-0b31-49b7-9ab0-587f6f7113ea_xpylotgl" returned: 1 in 0.414s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e50588-0b31-49b7-9ab0-587f6f7113ea_xpylotgl' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:15:12 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0b945a-8ae6-4967-832e-dbda313e9d26]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:12 devstack sudo[111647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD Aug 26 12:15:12 devstack sudo[111647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:12 devstack sudo[111647]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:12 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-2b7df8f2-f7e4-41e3-a888-eff02f60e5f6 req-d0d4fb63-54f3-4655-9f88-7aed153d4e57 tempest-TestStampPattern-753289935 None] Terminate volume connection completed successfully. Aug 26 12:15:12 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-2b7df8f2-f7e4-41e3-a888-eff02f60e5f6 req-d0d4fb63-54f3-4655-9f88-7aed153d4e57 tempest-TestStampPattern-753289935 None] Deleting attachment 14452bdc-69f4-4acf-ac62-147aa352fb47. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:15:12 devstack sudo[111656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD Aug 26 12:15:12 devstack sudo[111656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:13 devstack sudo[111656]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:15:13 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] 23e50588-0b31-49b7-9ab0-587f6f7113ea was raw, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:15:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:13 devstack sudo[111662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 Aug 26 12:15:13 devstack sudo[111662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:13 devstack sudo[111662]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4" returned: 0 in 0.481s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:13 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23e50588-0b31-49b7-9ab0-587f6f7113ea_8v7xbooydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:15:13 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 12:15:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:13 devstack sudo[111668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 1G Aug 26 12:15:13 devstack sudo[111668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:14 devstack sudo[111668]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 1G" returned: 0 in 0.415s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Downloaded image 23e50588-0b31-49b7-9ab0-587f6f7113ea ((None, [{'url': 'file:///opt/stack/data/glance/images/23e50588-0b31-49b7-9ab0-587f6f7113ea', 'metadata': {}}])) to volume f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Temporary image 23e50588-0b31-49b7-9ab0-587f6f7113ea for user 7499635d05f4480fb180bdade63dbf61 is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Marking volume f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Copying metadata from image 23e50588-0b31-49b7-9ab0-587f6f7113ea to f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Creating volume glance metadata for volume f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 backed by image 23e50588-0b31-49b7-9ab0-587f6f7113ea with: {'image_id': '23e50588-0b31-49b7-9ab0-587f6f7113ea', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2b0a8e92673d982c832633a699beb2a7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a1d237-c64b-4a90-b514-3f2bbed178d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4', 'volume_size': 1, 'image_id': '23e50588-0b31-49b7-9ab0-587f6f7113ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e50588-0b31-49b7-9ab0-587f6f7113ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b0a8e92673d982c832633a699beb2a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'abc6102d2eaf4a339fcf3c5daeef294d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c34baa59f09c5297fe040411a95f3f3526496b93a1b979dec16620777eccab3e7f821926e2b61863bdfb6b259c0a8a1ac47c8811ec2a63caf14b6a88e4d39a6c', 'id': '23e50588-0b31-49b7-9ab0-587f6f7113ea', 'created_at': datetime.datetime(2026, 8, 26, 10, 15, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 15, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e50588-0b31-49b7-9ab0-587f6f7113ea/file', 'properties': {}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca30c24-1859-4a80-a487-8405f34f4ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:14 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Volume volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 (f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4): created successfully Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca30c24-1859-4a80-a487-8405f34f4ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Flow 'volume_create_manager' (df0b8fde-c47d-4086-ba0a-3cfc69fcbd6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3f727f67-b640-4cb1-b353-f1a645ff558d tempest-VolumeImageDependencyTests-1687146319 None] Created volume successfully. Aug 26 12:15:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Acquiring lock "cinder-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Lock "cinder-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Acquiring lock "cinder-quobyte-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Lock "cinder-quobyte-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:15 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[03472f74-9fd0-44a1-b4a5-066bcf95af6c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:15 devstack sudo[111702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 Aug 26 12:15:15 devstack sudo[111702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:15 devstack sudo[111702]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4" returned: 0 in 0.455s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:15 devstack sudo[111710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4 Aug 26 12:15:15 devstack sudo[111710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:16 devstack sudo[111710]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4" returned: 0 in 0.270s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Lock "cinder-quobyte-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4" released by "delete_volume" :: held 0.772s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Created reservations ['f648b42b-f155-4773-b304-a99f8e7c5091', '7daf344e-c8ff-4dbc-925c-ea400401af12', 'bbd299de-0aa4-4082-bc0e-ba2e5ddf7e5c', 'c9c8d548-4d41-4c70-b98a-9edd5d06cf16'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:16 devstack sudo[111713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:16 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:16 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.271s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Deleted volume successfully. Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5ae8c013-73cb-4764-9bab-3eaa89a9ec73 tempest-VolumeImageDependencyTests-1687146319 None] Lock "cinder-f7f9cc2f-efeb-4d21-87c2-88cd83b52cc4-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Acquiring lock "cinder-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Lock "cinder-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Acquiring lock "cinder-quobyte-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fce16f-c575-4eb7-b768-9e9b193b9e3a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:16 devstack sudo[111716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 Aug 26 12:15:16 devstack sudo[111716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:17 devstack sudo[111716]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" returned: 0 in 0.384s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:17 devstack sudo[111721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0 Aug 26 12:15:17 devstack sudo[111721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:17 devstack sudo[111721]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" returned: 0 in 0.282s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0" released by "delete_volume" :: held 0.714s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Created reservations ['4504c5fb-cb97-4a02-8627-e6236d37520a', '7a32a24f-8aa2-468f-85d1-30a3f1754e1b', '6dcf8e17-634c-4d70-88ea-38e0d4e56101', 'ed1250f7-f05b-48c1-9caa-e318e84c7260'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:17 devstack sudo[111724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:17 devstack sudo[111724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:17 devstack sudo[111724]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.277s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:17 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Deleted volume successfully. Aug 26 12:15:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a34f947e-53c0-448c-aa3c-c2f2dcdf637e tempest-TestStampPattern-753289935 None] Lock "cinder-53a4cf81-a5e7-4eef-b1c7-866f1b0fdff0-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Acquiring lock "cinder-70fa28b4-49d6-453f-9a97-32afd58d819b-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Lock "cinder-70fa28b4-49d6-453f-9a97-32afd58d819b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Acquiring lock "cinder-quobyte-d2f393dd-ac9f-4def-890e-3f1f041b4343" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-d2f393dd-ac9f-4def-890e-3f1f041b4343" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Acquiring lock "cinder-quobyte-70fa28b4-49d6-453f-9a97-32afd58d819b" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-70fa28b4-49d6-453f-9a97-32afd58d819b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Deleting offline snapshot 70fa28b4-49d6-453f-9a97-32afd58d819b of volume d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] snapshot_file for this snap is: volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a713cef7-4ad2-4714-be41-017be7110999]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:18 devstack sudo[111727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b Aug 26 12:15:18 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:18 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b" returned: 0 in 0.372s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f393dd-ac9f-4def-890e-3f1f041b4343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[6804d721-9c5d-4fe1-8fbe-3862de5b1120]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:18 devstack sudo[111732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 Aug 26 12:15:18 devstack sudo[111732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:19 devstack sudo[111732]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343" returned: 0 in 0.514s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:19 devstack sudo[111737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b Aug 26 12:15:19 devstack sudo[111737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:19 devstack sudo[111737]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:19 devstack sudo[111743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b Aug 26 12:15:19 devstack sudo[111743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:19 devstack sudo[111743]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343.70fa28b4-49d6-453f-9a97-32afd58d819b" returned: 0 in 0.249s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-70fa28b4-49d6-453f-9a97-32afd58d819b" released by "_delete_snapshot" :: held 1.585s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-d2f393dd-ac9f-4def-890e-3f1f041b4343" released by "delete_snapshot" :: held 1.606s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:19 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Created reservations ['3b04487a-8828-4985-a31a-e0bb8f1b83d2', '6f39a56a-8dc3-4495-8e8d-c229f2cca496', '52cf3e0b-1ec9-4abc-9720-175db679d0b4', '6a072572-fecd-42db-8c38-86e891a535cd'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:19 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Delete snapshot completed successfully. Aug 26 12:15:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5af05b8b-14c4-4d83-bfba-c17ae750c69c tempest-TestStampPattern-753289935 None] Lock "cinder-70fa28b4-49d6-453f-9a97-32afd58d819b-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Acquiring lock "cinder-d2f393dd-ac9f-4def-890e-3f1f041b4343-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Lock "cinder-d2f393dd-ac9f-4def-890e-3f1f041b4343-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Acquiring lock "cinder-quobyte-d2f393dd-ac9f-4def-890e-3f1f041b4343" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:23 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-d2f393dd-ac9f-4def-890e-3f1f041b4343" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30cf735-f8ab-41b9-89ee-8f77d70e3b5f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:23 devstack sudo[111775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 Aug 26 12:15:23 devstack sudo[111775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:24 devstack sudo[111775]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343" returned: 0 in 0.359s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:24 devstack sudo[111780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343 Aug 26 12:15:24 devstack sudo[111780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:24 devstack sudo[111780]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d2f393dd-ac9f-4def-890e-3f1f041b4343" returned: 0 in 0.255s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Lock "cinder-quobyte-d2f393dd-ac9f-4def-890e-3f1f041b4343" released by "delete_volume" :: held 0.670s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Created reservations ['43968f2d-8ec1-4849-ad92-9c250a28b2a8', 'e8500887-2e2c-43f5-8777-cb1a938341cc', 'd0f6bd1a-6248-4bf6-99b7-88f4111967b9', 'e3a68c41-44bb-4efb-b369-111eb2ef1a0b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:24 devstack sudo[111783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:24 devstack sudo[111783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:24 devstack sudo[111783]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.239s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:24 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Deleted volume successfully. Aug 26 12:15:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fb9808cc-0241-41e1-812f-f9171f8fd56f tempest-TestStampPattern-753289935 None] Lock "cinder-d2f393dd-ac9f-4def-890e-3f1f041b4343-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-55fdf452-1203-4260-a402-f6572fa44497 tempest-TestShelveInstance-1172287496 None] Terminate volume connection completed successfully. Aug 26 12:15:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-55fdf452-1203-4260-a402-f6572fa44497 tempest-TestShelveInstance-1172287496 None] Deleting attachment f52105db-f2ba-40c5-a240-1e6d62bbc56f. {{(pid=94387) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 12:15:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Acquiring lock "cinder-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Lock "cinder-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Acquiring lock "cinder-quobyte-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Lock "cinder-quobyte-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:28 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a646762-936e-4bf8-b169-4edccbf5d885]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:28 devstack sudo[111820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff Aug 26 12:15:28 devstack sudo[111820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:29 devstack sudo[111820]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff" returned: 0 in 0.509s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:29 devstack sudo[111825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff Aug 26 12:15:29 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:29 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff" returned: 0 in 0.263s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Lock "cinder-quobyte-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff" released by "delete_volume" :: held 0.833s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG cinder.quota [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Created reservations ['3781489b-80fb-4ba3-b9ea-46f2b5a1df3d', '11e033f3-0f72-4345-a078-20d86cd1504a', '36785d13-f6a5-4d0f-a11e-c1a64b323b61', 'fd499ba0-baa4-4951-a33b-589780bb8813'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:29 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:29 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:30 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.339s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:30 devstack cinder-volume[94387]: DEBUG cinder.manager [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Deleted volume successfully. Aug 26 12:15:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [req-9a4bd47d-6f42-4907-a79c-e0abf1c6c3fb req-1e9a34af-1a7e-4719-98a2-4e7b13582ea8 tempest-TestShelveInstance-1172287496 None] Lock "cinder-ceb91ad6-64d5-43cd-8cc8-58cd7d532eff-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:39 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=54,cinder:INSERT=27,cinder:UPDATE=68,cinder:DELETE=5 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:15:40 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=66,cinder:UPDATE=67,cinder:INSERT=16,cinder:DELETE=3 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (a2ccfe40-d52f-4af3-8c49-9c1c1e2d89db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cad9a5-5b25-4f1b-b213-01ec26a914eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cad9a5-5b25-4f1b-b213-01ec26a914eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2102065406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6700cb64-7cec-4ed7-b246-afb897272e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:42Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93f699a-7ae9-4e4c-aeb1-c9145ecd7645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93f699a-7ae9-4e4c-aeb1-c9145ecd7645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cfc08a-71e7-4b9b-aba4-dad72d132b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cfc08a-71e7-4b9b-aba4-dad72d132b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6700cb64-7cec-4ed7-b246-afb897272e52', 'volume_name': 'volume-6700cb64-7cec-4ed7-b246-afb897272e52', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7591b67c-d2c1-43b4-a082-eade7e70773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7591b67c-d2c1-43b4-a082-eade7e70773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df281ead-02d2-425f-882d-dee7af70d1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Volume 6700cb64-7cec-4ed7-b246-afb897272e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6700cb64-7cec-4ed7-b246-afb897272e52', 'volume_size': 1} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2102065406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6700cb64-7cec-4ed7-b246-afb897272e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:42Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Creating volume 6700cb64-7cec-4ed7-b246-afb897272e52 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:15:42 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:42 devstack sudo[111882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52 1073741824 Aug 26 12:15:42 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (2c4af432-83d3-4ddc-bb78-c574d98542d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b9dd45-201d-4373-8901-806064f0eac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b9dd45-201d-4373-8901-806064f0eac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375832377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:42Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3b6df4-863a-4cb4-a33e-b3dcda032b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3b6df4-863a-4cb4-a33e-b3dcda032b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697031ca-81b6-45d7-a055-7f98dc41fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697031ca-81b6-45d7-a055-7f98dc41fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121', 'volume_name': 'volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa263a08-8666-47fe-ad39-7bb1536ba319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa263a08-8666-47fe-ad39-7bb1536ba319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158fea36-1ea7-48ed-9b2f-94d5e303f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:42 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Volume 4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121', 'volume_size': 1} Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:42 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52 1073741824" returned: 0 in 0.709s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:43 devstack sudo[111888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52 Aug 26 12:15:43 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (9da99c1b-242e-4963-9093-f8cc75dacfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3e34e2-d11a-4cb8-8ad9-ca0eaf3c6049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3e34e2-d11a-4cb8-8ad9-ca0eaf3c6049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-271551206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ad925f-4289-4fa1-ab27-3a89f98fcd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:43Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03ba825-48bf-4cbf-9e95-d8b74be76048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03ba825-48bf-4cbf-9e95-d8b74be76048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190df2d1-1815-43e8-9ab7-4b6d341b6274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190df2d1-1815-43e8-9ab7-4b6d341b6274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ad925f-4289-4fa1-ab27-3a89f98fcd88', 'volume_name': 'volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0830edbb-712c-4e23-ad33-a13f07acd631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0830edbb-712c-4e23-ad33-a13f07acd631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9bdb8b-6f0d-4324-a43b-a54779b575e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Volume d1ad925f-4289-4fa1-ab27-3a89f98fcd88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88', 'volume_size': 1} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:43 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52" returned: 0 in 0.370s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375832377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:42Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Creating volume 4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:15:43 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df281ead-02d2-425f-882d-dee7af70d1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6700cb64-7cec-4ed7-b246-afb897272e52', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66611033-4f62-4b4a-8ddf-83bf323ed185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack sudo[111891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 1073741824 Aug 26 12:15:43 devstack sudo[111891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Volume volume-6700cb64-7cec-4ed7-b246-afb897272e52 (6700cb64-7cec-4ed7-b246-afb897272e52): created successfully Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66611033-4f62-4b4a-8ddf-83bf323ed185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (a2ccfe40-d52f-4af3-8c49-9c1c1e2d89db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (fcbe25ff-f1b4-45da-bce5-7b52516d4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d876ca5-419a-4ed2-8758-c901f69c0b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d8d9d90e-f665-45b0-9a66-506947971a7f tempest-CreateVolumesFromImageTest-1460229200 None] Created volume successfully. Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d876ca5-419a-4ed2-8758-c901f69c0b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-42939956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b79beb-81bd-4ab8-9acc-e7c0d813210f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:43Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dcaf10-c852-452a-b096-f7a1110d743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dcaf10-c852-452a-b096-f7a1110d743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fb91ca-2ac0-46af-ae31-63b7588b16a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fb91ca-2ac0-46af-ae31-63b7588b16a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b79beb-81bd-4ab8-9acc-e7c0d813210f', 'volume_name': 'volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab8cad4-96ab-4245-8335-116f92679e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab8cad4-96ab-4245-8335-116f92679e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e416051-812c-41ba-ad5d-9f93cdabdca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Volume 97b79beb-81bd-4ab8-9acc-e7c0d813210f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f', 'volume_size': 1} Aug 26 12:15:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:44 devstack sudo[111891]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 1073741824" returned: 0 in 0.710s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (29c0b411-2562-4ab1-869b-155ef18a0f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61602d9-cdfa-4393-9977-5fe1cd327399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61602d9-cdfa-4393-9977-5fe1cd327399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-383371432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86a2493-e06c-4611-8404-d1f5dc7e91d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:44Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411ebb4b-e9bc-4fb9-87a4-8ee58fb28a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:44 devstack sudo[111899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 Aug 26 12:15:44 devstack sudo[111899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411ebb4b-e9bc-4fb9-87a4-8ee58fb28a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f55f74c-802b-442e-b23d-7109248fae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f55f74c-802b-442e-b23d-7109248fae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86a2493-e06c-4611-8404-d1f5dc7e91d6', 'volume_name': 'volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67fe41e5-6863-45b0-8e46-95abcc3848bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67fe41e5-6863-45b0-8e46-95abcc3848bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f076ae45-b8a4-4a7f-88c0-8810f6f53fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:44 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Volume b86a2493-e06c-4611-8404-d1f5dc7e91d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6', 'volume_size': 1} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:44 devstack sudo[111899]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121" returned: 0 in 0.295s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-271551206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ad925f-4289-4fa1-ab27-3a89f98fcd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:43Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Creating volume d1ad925f-4289-4fa1-ab27-3a89f98fcd88 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:15:44 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158fea36-1ea7-48ed-9b2f-94d5e303f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:44 devstack sudo[111902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 1073741824 Aug 26 12:15:44 devstack sudo[111902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8e8104-cc63-43cd-9508-1011d69ddecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:44 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Volume volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 (4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121): created successfully Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8e8104-cc63-43cd-9508-1011d69ddecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (2c4af432-83d3-4ddc-bb78-c574d98542d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:44 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d6c97c44-9e7e-4bec-bf8b-9a960515334f tempest-CreateVolumesFromImageTest-1460229200 None] Created volume successfully. Aug 26 12:15:45 devstack sudo[111902]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 1073741824" returned: 0 in 0.457s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:45 devstack sudo[111907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 Aug 26 12:15:45 devstack sudo[111907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:45 devstack sudo[111907]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88" returned: 0 in 0.277s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-42939956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b79beb-81bd-4ab8-9acc-e7c0d813210f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:43Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Creating volume 97b79beb-81bd-4ab8-9acc-e7c0d813210f {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:15:45 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9bdb8b-6f0d-4324-a43b-a54779b575e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc49f716-c980-44ee-9837-2b82088d819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:45 devstack sudo[111910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f 1073741824 Aug 26 12:15:45 devstack sudo[111910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:45 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Volume volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 (d1ad925f-4289-4fa1-ab27-3a89f98fcd88): created successfully Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc49f716-c980-44ee-9837-2b82088d819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (9da99c1b-242e-4963-9093-f8cc75dacfa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:45 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-79a36862-55e3-4423-bd3a-fa61f280fde1 tempest-CreateVolumesFromImageTest-1460229200 None] Created volume successfully. Aug 26 12:15:46 devstack sudo[111910]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f 1073741824" returned: 0 in 0.645s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:46 devstack sudo[111917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f Aug 26 12:15:46 devstack sudo[111917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:46 devstack sudo[111917]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f" returned: 0 in 0.354s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-383371432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86a2493-e06c-4611-8404-d1f5dc7e91d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f22fd70ada4920ac97f3dc52f9308f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:44Z,use_quota=True,user_id='fb71571ae8c149bd8efca48c2c3829ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Creating volume b86a2493-e06c-4611-8404-d1f5dc7e91d6 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:15:46 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e416051-812c-41ba-ad5d-9f93cdabdca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:46 devstack sudo[111920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 1073741824 Aug 26 12:15:46 devstack sudo[111920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283f5fa3-e24e-4aea-a39c-6e34d12d143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:46 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Volume volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f (97b79beb-81bd-4ab8-9acc-e7c0d813210f): created successfully Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283f5fa3-e24e-4aea-a39c-6e34d12d143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (fcbe25ff-f1b4-45da-bce5-7b52516d4046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-16244953-4e38-4850-b394-20a7d72039f3 tempest-CreateVolumesFromImageTest-1460229200 None] Created volume successfully. Aug 26 12:15:46 devstack sudo[111920]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 1073741824" returned: 0 in 0.549s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:47 devstack sudo[111926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 Aug 26 12:15:47 devstack sudo[111926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:47 devstack sudo[111926]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6" returned: 0 in 0.277s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f076ae45-b8a4-4a7f-88c0-8810f6f53fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b4340d-f3ad-4b39-91cd-7dc490680046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:47 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Volume volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 (b86a2493-e06c-4611-8404-d1f5dc7e91d6): created successfully Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b4340d-f3ad-4b39-91cd-7dc490680046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Flow 'volume_create_manager' (29c0b411-2562-4ab1-869b-155ef18a0f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:47 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5dad1395-c997-4c0a-a250-9a03913eb73f tempest-CreateVolumesFromImageTest-1460229200 None] Created volume successfully. Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-b86a2493-e06c-4611-8404-d1f5dc7e91d6-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-b86a2493-e06c-4611-8404-d1f5dc7e91d6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-quobyte-b86a2493-e06c-4611-8404-d1f5dc7e91d6" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-b86a2493-e06c-4611-8404-d1f5dc7e91d6" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[60337238-34a8-43aa-b4f0-2a320c401bc2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:47 devstack sudo[111929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 Aug 26 12:15:47 devstack sudo[111929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:48 devstack sudo[111929]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6" returned: 0 in 0.416s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:48 devstack sudo[111935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6 Aug 26 12:15:48 devstack sudo[111935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:48 devstack sudo[111935]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b86a2493-e06c-4611-8404-d1f5dc7e91d6" returned: 0 in 0.284s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-b86a2493-e06c-4611-8404-d1f5dc7e91d6" released by "delete_volume" :: held 0.751s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Created reservations ['cb886b7f-27ba-4fc7-a1ab-0f02f77643e0', '7464073f-5983-4810-82ee-e35e1e7d3aec', 'c9b7ddc2-0e73-467e-b49e-d6b1063757c5', '366982e2-8d5b-401a-81fc-f9ba41f82bcc'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:48 devstack sudo[111938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:48 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-97b79beb-81bd-4ab8-9acc-e7c0d813210f-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-97b79beb-81bd-4ab8-9acc-e7c0d813210f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:48 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.293s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:48 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Deleted volume successfully. Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-quobyte-97b79beb-81bd-4ab8-9acc-e7c0d813210f" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-10ceafa0-c763-4426-a8e0-ae87df74d818 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-b86a2493-e06c-4611-8404-d1f5dc7e91d6-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-97b79beb-81bd-4ab8-9acc-e7c0d813210f" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9ae6fa-c8b5-4442-8df1-cee33fba750b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:49 devstack sudo[111941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f Aug 26 12:15:49 devstack sudo[111941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:49 devstack sudo[111941]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f" returned: 0 in 0.394s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:49 devstack sudo[111947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f Aug 26 12:15:49 devstack sudo[111947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:49 devstack sudo[111947]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-97b79beb-81bd-4ab8-9acc-e7c0d813210f" returned: 0 in 0.265s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-97b79beb-81bd-4ab8-9acc-e7c0d813210f" released by "delete_volume" :: held 0.700s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Created reservations ['56322112-6ab8-47ea-a85d-52de55a4fd3a', '17bdc658-2ca9-48c7-b8e4-5a49eb5d5b58', '969eea5e-ac58-4666-aef4-a34a7d0b3ffb', '92c1b03e-d4c5-4fdb-a1ae-779cef76a21f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:49 devstack sudo[111950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:49 devstack sudo[111950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-d1ad925f-4289-4fa1-ab27-3a89f98fcd88-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-d1ad925f-4289-4fa1-ab27-3a89f98fcd88-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:50 devstack sudo[111950]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.312s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Deleted volume successfully. Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-03ede79b-b44e-4ede-b88a-59a68a68d3c7 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-97b79beb-81bd-4ab8-9acc-e7c0d813210f-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-quobyte-d1ad925f-4289-4fa1-ab27-3a89f98fcd88" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-d1ad925f-4289-4fa1-ab27-3a89f98fcd88" acquired by "delete_volume" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d194619a-85a9-436c-8943-7f42b82171d4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:50 devstack sudo[111953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 Aug 26 12:15:50 devstack sudo[111953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:50 devstack sudo[111953]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88" returned: 0 in 0.372s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:50 devstack sudo[111958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88 Aug 26 12:15:50 devstack sudo[111958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:50 devstack sudo[111958]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d1ad925f-4289-4fa1-ab27-3a89f98fcd88" returned: 0 in 0.259s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-d1ad925f-4289-4fa1-ab27-3a89f98fcd88" released by "delete_volume" :: held 0.673s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:50 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Created reservations ['071c2fa5-49a4-4ed7-b60e-aefc5d343a19', '9b6cf164-3a19-4356-a80d-1b997e2b571a', 'cdcebb67-efd3-441a-a537-8d85b85e2b31', '8c7bed06-8d30-4a38-8ff8-2495ae78b634'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:51 devstack sudo[111961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:51 devstack sudo[111961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:51 devstack sudo[111961]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.269s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Deleted volume successfully. Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5b2c5be3-50ad-48c9-aa23-bd647e54d66a tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-d1ad925f-4289-4fa1-ab27-3a89f98fcd88-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-quobyte-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7236ca-5ea9-4d8f-b572-bdc30c10d345]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:51 devstack sudo[111964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 Aug 26 12:15:51 devstack sudo[111964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:51 devstack sudo[111964]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121" returned: 0 in 0.384s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:51 devstack sudo[111969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121 Aug 26 12:15:51 devstack sudo[111969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:52 devstack sudo[111969]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121" returned: 0 in 0.245s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121" released by "delete_volume" :: held 0.671s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Created reservations ['c38fbe9e-af1a-49df-b4e4-ebd40e3805e3', '97ec398a-1599-4c9e-a79d-2bba303670c5', '104c0597-aa78-43cb-bf35-d653cb652c1f', '588d3af0-eff4-41c0-9298-be77373e3378'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:52 devstack sudo[111972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:52 devstack sudo[111972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-6700cb64-7cec-4ed7-b246-afb897272e52-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-6700cb64-7cec-4ed7-b246-afb897272e52-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "cinder-quobyte-6700cb64-7cec-4ed7-b246-afb897272e52" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-6700cb64-7cec-4ed7-b246-afb897272e52" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:15:52 devstack sudo[111972]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.455s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[898788db-2756-4bf1-b027-9992b86ab16c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:52 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Deleted volume successfully. Aug 26 12:15:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6c159c4e-0bd0-4d28-a7c9-1478525829e8 tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-4dfb7815-6e38-4e0b-9aeb-02cfbd1d9121-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:52 devstack sudo[111975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52 Aug 26 12:15:52 devstack sudo[111975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:53 devstack sudo[111975]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52" returned: 0 in 0.370s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:53 devstack sudo[111980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52 Aug 26 12:15:53 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:53 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-6700cb64-7cec-4ed7-b246-afb897272e52" returned: 0 in 0.256s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-quobyte-6700cb64-7cec-4ed7-b246-afb897272e52" released by "delete_volume" :: held 0.684s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Created reservations ['e78e5213-fdc6-48b1-8429-67a5d940ed5b', '595d7d02-c9b1-43a8-8bb7-7e26fa70efd0', 'd23ee330-5668-4a90-b0dc-41f757f712fb', '93cf36b9-7520-42ba-ba06-b4ca2fce586b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:53 devstack sudo[111983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:15:53 devstack sudo[111983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:53 devstack sudo[111983]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.266s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:15:53 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Deleted volume successfully. Aug 26 12:15:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8342873a-6300-42bd-b6f1-84ce2a2f213f tempest-CreateVolumesFromImageTest-1460229200 None] Lock "cinder-6700cb64-7cec-4ed7-b246-afb897272e52-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Flow 'volume_create_manager' (76e1b782-80e6-4a65-a493-7982b818aeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b91721-421e-4231-9a1a-d18031ba29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b91721-421e-4231-9a1a-d18031ba29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218042985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0647d1-de99-486e-ab01-2307d25e160a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1103b89cc7644935afabf0b0954640ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:58Z,use_quota=True,user_id='fe1bde3ef5854bb0822113428f8ac276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36df81e-2078-4253-ae86-bee8cc6f3efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36df81e-2078-4253-ae86-bee8cc6f3efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfde919-c098-4bdc-a0de-0e4ac78d7ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfde919-c098-4bdc-a0de-0e4ac78d7ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0647d1-de99-486e-ab01-2307d25e160a', 'volume_name': 'volume-2e0647d1-de99-486e-ab01-2307d25e160a', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3403db7-b4bd-49f7-b547-6f3a09d6b54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3403db7-b4bd-49f7-b547-6f3a09d6b54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61081cf9-e805-4215-8690-5682bfd1fc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:57 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Volume 2e0647d1-de99-486e-ab01-2307d25e160a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0647d1-de99-486e-ab01-2307d25e160a', 'volume_size': 1} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218042985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0647d1-de99-486e-ab01-2307d25e160a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1103b89cc7644935afabf0b0954640ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:58Z,use_quota=True,user_id='fe1bde3ef5854bb0822113428f8ac276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Creating volume 2e0647d1-de99-486e-ab01-2307d25e160a {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:15:57 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:15:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:57 devstack sudo[111987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a 1073741824 Aug 26 12:15:57 devstack sudo[111987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:58 devstack sudo[111987]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a 1073741824" returned: 0 in 0.425s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:58 devstack sudo[111993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a Aug 26 12:15:58 devstack sudo[111993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:58 devstack sudo[111993]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a" returned: 0 in 0.294s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Flow 'volume_create_manager' (af7fed08-b1b3-47ee-9ad9-46d005649db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c8d183-f249-480f-a62e-71a648dd053a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61081cf9-e805-4215-8690-5682bfd1fc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0647d1-de99-486e-ab01-2307d25e160a', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb0e197-7362-43cd-a52f-86485981067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c8d183-f249-480f-a62e-71a648dd053a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1729269916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb63ecb1-f699-4304-837d-d7ea4fbf46fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29bbd02b1f94bb0af505cb065a21d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:59Z,use_quota=True,user_id='57d0c4128e394028838d72e0f89e566a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc0608c-7e67-410a-b559-1d8910acaa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc0608c-7e67-410a-b559-1d8910acaa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421f40c2-00c0-4bbd-8445-469ce58eb74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421f40c2-00c0-4bbd-8445-469ce58eb74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb63ecb1-f699-4304-837d-d7ea4fbf46fd', 'volume_name': 'volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff848848-ca0b-4853-bcd6-32822c9f0b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff848848-ca0b-4853-bcd6-32822c9f0b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1207f29-f8b5-4efc-8050-36be3f00ffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Volume eb63ecb1-f699-4304-837d-d7ea4fbf46fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd', 'volume_size': 1} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1729269916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb63ecb1-f699-4304-837d-d7ea4fbf46fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29bbd02b1f94bb0af505cb065a21d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:15:59Z,use_quota=True,user_id='57d0c4128e394028838d72e0f89e566a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Creating volume eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:15:58 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Volume volume-2e0647d1-de99-486e-ab01-2307d25e160a (2e0647d1-de99-486e-ab01-2307d25e160a): created successfully Aug 26 12:15:58 devstack sudo[111996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd 1073741824 Aug 26 12:15:58 devstack sudo[111996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb0e197-7362-43cd-a52f-86485981067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Flow 'volume_create_manager' (76e1b782-80e6-4a65-a493-7982b818aeb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-36bd94f5-2f72-452e-8207-0295173f4422 tempest-ProjectReaderTests-848389828 None] Created volume successfully. Aug 26 12:15:59 devstack sudo[111996]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd 1073741824" returned: 0 in 0.418s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:15:59 devstack sudo[112002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd Aug 26 12:15:59 devstack sudo[112002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:15:59 devstack sudo[112002]: pam_unix(sudo:session): session closed for user root Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" returned: 0 in 0.242s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1207f29-f8b5-4efc-8050-36be3f00ffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec857344-e015-434b-bae2-d1825320e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:15:59 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Volume volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd (eb63ecb1-f699-4304-837d-d7ea4fbf46fd): created successfully Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec857344-e015-434b-bae2-d1825320e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Flow 'volume_create_manager' (af7fed08-b1b3-47ee-9ad9-46d005649db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:15:59 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b7aec983-1edf-4f50-b29e-c26a7a7c8407 tempest-SnapshotDependencyTests-1007748680 None] Created volume successfully. Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Creating offline snapshot ac7f995a-c608-43b1-a43b-74d22b488e6c of volume eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac136d0f-0ff6-4c1d-866f-a958de9149a2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:15:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Acquiring lock "cinder-2e0647d1-de99-486e-ab01-2307d25e160a-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Lock "cinder-2e0647d1-de99-486e-ab01-2307d25e160a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:00 devstack sudo[112005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd Aug 26 12:16:00 devstack sudo[112005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Acquiring lock "cinder-quobyte-2e0647d1-de99-486e-ab01-2307d25e160a" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Lock "cinder-quobyte-2e0647d1-de99-486e-ab01-2307d25e160a" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8fa095-71a9-4677-8bd2-5cd017877b45]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:00 devstack sudo[112007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a Aug 26 12:16:00 devstack sudo[112007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:00 devstack sudo[112005]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" returned: 0 in 0.368s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:00 devstack sudo[112012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c 1G Aug 26 12:16:00 devstack sudo[112012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:00 devstack sudo[112007]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:00 devstack sudo[112017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a Aug 26 12:16:00 devstack sudo[112017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:00 devstack sudo[112012]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c 1G" returned: 0 in 0.396s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:00 devstack sudo[112017]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-2e0647d1-de99-486e-ab01-2307d25e160a" returned: 0 in 0.258s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:00 devstack sudo[112023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c Aug 26 12:16:00 devstack sudo[112023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Lock "cinder-quobyte-2e0647d1-de99-486e-ab01-2307d25e160a" released by "delete_volume" :: held 0.651s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Created reservations ['28eef116-804e-4c57-9934-d2cb0ab16529', 'ebc4c013-7da4-488e-85db-f69bb88fa400', 'f01fe3d9-975a-4c9a-8339-87c052f25044', 'b7b80325-0985-488c-8332-43f98fc374de'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:00 devstack sudo[112025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:00 devstack sudo[112025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:01 devstack sudo[112023]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c" returned: 0 in 0.321s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:01 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c is being set with open permissions: ugo+rw Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:01 devstack sudo[112032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c Aug 26 12:16:01 devstack sudo[112032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:01 devstack sudo[112025]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.312s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:01 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Deleted volume successfully. Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-586094ce-c344-4e01-b216-1e38fca42102 tempest-ProjectReaderTests-848389828 None] Lock "cinder-2e0647d1-de99-486e-ab01-2307d25e160a-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:01 devstack sudo[112032]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c" returned: 0 in 0.300s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:01 devstack sudo[112036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.info Aug 26 12:16:01 devstack sudo[112036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:01 devstack sudo[112036]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.info" returned: 0 in 0.274s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:01 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.info is being set with open permissions: ugo+rw Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:01 devstack sudo[112039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.info Aug 26 12:16:01 devstack sudo[112039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Flow 'volume_create_manager' (6c6759e0-4ea7-4f40-be49-301c33030abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae3bb2d-8738-42a5-b315-a62b6a1c6997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae3bb2d-8738-42a5-b315-a62b6a1c6997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833185789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0923d416-3af8-4644-8849-faa7ecb1875b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1103b89cc7644935afabf0b0954640ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:02Z,use_quota=True,user_id='fe1bde3ef5854bb0822113428f8ac276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451c1a1c-406b-4982-b245-e662d1798339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451c1a1c-406b-4982-b245-e662d1798339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd02860c-188c-41cc-8a71-6c67df0d0e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd02860c-188c-41cc-8a71-6c67df0d0e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0923d416-3af8-4644-8849-faa7ecb1875b', 'volume_name': 'volume-0923d416-3af8-4644-8849-faa7ecb1875b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8e8d5a-62df-470f-9443-be355cf8aaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8e8d5a-62df-470f-9443-be355cf8aaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa9a555-9741-452e-be8a-012490fb83fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:01 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Volume 0923d416-3af8-4644-8849-faa7ecb1875b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0923d416-3af8-4644-8849-faa7ecb1875b', 'volume_size': 1} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:01 devstack sudo[112039]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.info" returned: 0 in 0.240s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833185789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0923d416-3af8-4644-8849-faa7ecb1875b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1103b89cc7644935afabf0b0954640ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:02Z,use_quota=True,user_id='fe1bde3ef5854bb0822113428f8ac276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Creating volume 0923d416-3af8-4644-8849-faa7ecb1875b {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:01 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:01 devstack sudo[112042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b 1073741824 Aug 26 12:16:01 devstack sudo[112042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:01 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-38f09c06-047f-4891-882f-0b15874d437d tempest-SnapshotDependencyTests-1007748680 None] Create snapshot completed successfully Aug 26 12:16:02 devstack sudo[112042]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b 1073741824" returned: 0 in 0.451s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:02 devstack sudo[112048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b Aug 26 12:16:02 devstack sudo[112048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:02 devstack sudo[112048]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b" returned: 0 in 0.278s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Flow 'volume_create_manager' (6260dea1-134e-4902-a260-95a3bfc0d3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81606d3a-8396-4d3a-86b7-cc0ee4da5300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa9a555-9741-452e-be8a-012490fb83fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0923d416-3af8-4644-8849-faa7ecb1875b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1506688-7ae3-4c59-8af5-f609cef45e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81606d3a-8396-4d3a-86b7-cc0ee4da5300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9574a722-cbdd-4f42-b2c5-13c86ac2e264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29bbd02b1f94bb0af505cb065a21d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac7f995a-c608-43b1-a43b-74d22b488e6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:03Z,use_quota=True,user_id='57d0c4128e394028838d72e0f89e566a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653de147-05e7-45e9-b69d-fdc89535eacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653de147-05e7-45e9-b69d-fdc89535eacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f14c6-7f03-4136-bfcd-2761fa4a28d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f14c6-7f03-4136-bfcd-2761fa4a28d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9574a722-cbdd-4f42-b2c5-13c86ac2e264', 'volume_name': 'volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264', 'volume_size': 1, 'snapshot_id': 'ac7f995a-c608-43b1-a43b-74d22b488e6c'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a0a61f-aa61-4718-a384-bbb3de46941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a0a61f-aa61-4718-a384-bbb3de46941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d567ac6f-fac6-42f8-9985-5ed504a54ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:02 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Volume 9574a722-cbdd-4f42-b2c5-13c86ac2e264: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264', 'volume_size': 1, 'snapshot_id': 'ac7f995a-c608-43b1-a43b-74d22b488e6c'} Aug 26 12:16:02 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Volume volume-0923d416-3af8-4644-8849-faa7ecb1875b (0923d416-3af8-4644-8849-faa7ecb1875b): created successfully Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1506688-7ae3-4c59-8af5-f609cef45e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Flow 'volume_create_manager' (6c6759e0-4ea7-4f40-be49-301c33030abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "cinder-quobyte-ac7f995a-c608-43b1-a43b-74d22b488e6c-9574a722-cbdd-4f42-b2c5-13c86ac2e264" by "_create_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fcf9aa94-933e-4ac2-8bb6-92454a29c895 tempest-ProjectReaderTests-848389828 None] Created volume successfully. Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-ac7f995a-c608-43b1-a43b-74d22b488e6c-9574a722-cbdd-4f42-b2c5-13c86ac2e264" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Creating volume 9574a722-cbdd-4f42-b2c5-13c86ac2e264 from snapshot ac7f995a-c608-43b1-a43b-74d22b488e6c {{(pid=94387) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "cinder-quobyte-9574a722-cbdd-4f42-b2c5-13c86ac2e264" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-9574a722-cbdd-4f42-b2c5-13c86ac2e264" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] snapshot: ac7f995a-c608-43b1-a43b-74d22b488e6c, volume: 9574a722-cbdd-4f42-b2c5-13c86ac2e264, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e71a3b0-fc4a-427a-9c4b-1c9172d41e2f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:03 devstack sudo[112051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c Aug 26 12:16:03 devstack sudo[112051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:03 devstack sudo[112051]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bc15b4-7a5a-4b59-bf51-7f1bbfe5e799]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:03 devstack sudo[112056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd Aug 26 12:16:03 devstack sudo[112056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:03 devstack sudo[112056]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" returned: 0 in 0.365s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:03 devstack sudo[112061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 Aug 26 12:16:03 devstack sudo[112061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Acquiring lock "cinder-0923d416-3af8-4644-8849-faa7ecb1875b-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Lock "cinder-0923d416-3af8-4644-8849-faa7ecb1875b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Acquiring lock "cinder-quobyte-0923d416-3af8-4644-8849-faa7ecb1875b" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Lock "cinder-quobyte-0923d416-3af8-4644-8849-faa7ecb1875b" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca283f-0541-4f8b-adc0-bd2029049052]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:04 devstack sudo[112065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b Aug 26 12:16:04 devstack sudo[112065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:04 devstack sudo[112065]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b" returned: 0 in 0.509s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:04 devstack sudo[112078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b Aug 26 12:16:04 devstack sudo[112078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:04 devstack sudo[112078]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0923d416-3af8-4644-8849-faa7ecb1875b" returned: 0 in 0.522s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Lock "cinder-quobyte-0923d416-3af8-4644-8849-faa7ecb1875b" released by "delete_volume" :: held 1.101s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:05 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Created reservations ['e359489f-676c-47c6-8967-a85eaf322dd3', '15c0e6b4-0e91-478b-8777-b783330312b6', 'e127d9bf-9ad5-441c-823a-7451cd2ded69', 'dd6b1fbc-46d4-445a-a1f7-b41aa7cea052'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:05 devstack sudo[112082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:05 devstack sudo[112082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:06 devstack sudo[112082]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.792s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:06 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:06 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Deleted volume successfully. Aug 26 12:16:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5e4523dd-fc57-453a-8d81-ad3499ded75e tempest-ProjectReaderTests-848389828 None] Lock "cinder-0923d416-3af8-4644-8849-faa7ecb1875b-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:08 devstack sudo[112061]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264" returned: 0 in 4.904s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:16:08 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Converted 1024.00 MB image at 208.76 MB/s Aug 26 12:16:08 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 is being set with open permissions: ugo+rw Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:08 devstack sudo[112086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 Aug 26 12:16:08 devstack sudo[112086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:08 devstack sudo[112086]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264" returned: 0 in 0.288s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-9574a722-cbdd-4f42-b2c5-13c86ac2e264" released by "_copy_volume_from_snapshot" :: held 5.993s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-ac7f995a-c608-43b1-a43b-74d22b488e6c-9574a722-cbdd-4f42-b2c5-13c86ac2e264" released by "_create_volume_from_snapshot" :: held 6.056s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.073s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d567ac6f-fac6-42f8-9985-5ed504a54ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264', 'volume_size': 1, 'snapshot_id': 'ac7f995a-c608-43b1-a43b-74d22b488e6c'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6584e160-1aa7-4453-8d81-48ede1efad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:08 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Volume volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 (9574a722-cbdd-4f42-b2c5-13c86ac2e264): created successfully Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6584e160-1aa7-4453-8d81-48ede1efad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Flow 'volume_create_manager' (6260dea1-134e-4902-a260-95a3bfc0d3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:08 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3dbd3efa-66fc-418c-9721-b38eb1d75370 tempest-SnapshotDependencyTests-1007748680 None] Created volume successfully. Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "cinder-ac7f995a-c608-43b1-a43b-74d22b488e6c-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-ac7f995a-c608-43b1-a43b-74d22b488e6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "cinder-quobyte-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "cinder-quobyte-ac7f995a-c608-43b1-a43b-74d22b488e6c" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-ac7f995a-c608-43b1-a43b-74d22b488e6c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Deleting offline snapshot ac7f995a-c608-43b1-a43b-74d22b488e6c of volume eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] snapshot_file for this snap is: volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5694d5cd-af56-4044-bd3e-57d9ef3abe02]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:09 devstack sudo[112090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c Aug 26 12:16:09 devstack sudo[112090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:09 devstack sudo[112090]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c" returned: 0 in 0.365s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[810b0734-e7e4-44cf-a3fa-850be1279ed2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:10 devstack sudo[112096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd Aug 26 12:16:10 devstack sudo[112096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:10 devstack sudo[112096]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" returned: 0 in 0.550s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:10 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c Aug 26 12:16:10 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:10 devstack sudo[112104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:10 devstack sudo[112104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:10 devstack sudo[112104]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:10 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c" returned: 0 in 0.376s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:16:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:16:10 devstack sudo[112110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c Aug 26 12:16:10 devstack sudo[112110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:11 devstack sudo[112110]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd.ac7f995a-c608-43b1-a43b-74d22b488e6c" returned: 0 in 0.251s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-ac7f995a-c608-43b1-a43b-74d22b488e6c" released by "_delete_snapshot" :: held 1.661s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" released by "delete_snapshot" :: held 1.687s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Created reservations ['97a661a5-5fe4-4684-8b8d-6c254bf36d13', '7ffde8d3-90a1-41bd-80a9-f5cd1dc2c5d7', '1ee85d65-c152-487c-b273-b34a23e076dd', '44eca158-d0a2-4b8f-b7e0-caaba0cbf9d7'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:11 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Delete snapshot completed successfully. Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d38ec722-0068-47fd-a50c-0de156085237 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-ac7f995a-c608-43b1-a43b-74d22b488e6c-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "cinder-eb63ecb1-f699-4304-837d-d7ea4fbf46fd-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-eb63ecb1-f699-4304-837d-d7ea4fbf46fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "cinder-quobyte-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2d334b-e223-4f75-9e0b-4d5d26375653]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:11 devstack sudo[112113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd Aug 26 12:16:11 devstack sudo[112113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:12 devstack sudo[112113]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" returned: 0 in 0.367s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:12 devstack sudo[112119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd Aug 26 12:16:12 devstack sudo[112119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:12 devstack sudo[112119]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" returned: 0 in 0.252s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-eb63ecb1-f699-4304-837d-d7ea4fbf46fd" released by "delete_volume" :: held 0.679s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Created reservations ['ef088afa-47ee-45ab-8e59-c6bfd64e912a', '9433db3f-eacb-4072-957b-5f1f85cbecda', '6006713b-6685-499e-b630-045989926172', 'e1e9d9fb-e69e-4fec-a8dd-f4fc55ae6a48'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:12 devstack sudo[112122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:12 devstack sudo[112122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:12 devstack sudo[112122]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.270s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:12 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Deleted volume successfully. Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "cinder-9574a722-cbdd-4f42-b2c5-13c86ac2e264-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5b7c384-39ad-4286-b163-047cb2503a19 tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-eb63ecb1-f699-4304-837d-d7ea4fbf46fd-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-9574a722-cbdd-4f42-b2c5-13c86ac2e264-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "cinder-quobyte-9574a722-cbdd-4f42-b2c5-13c86ac2e264" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-9574a722-cbdd-4f42-b2c5-13c86ac2e264" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa04541-26f1-4efc-87f0-9626c5c6774c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:13 devstack sudo[112125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 Aug 26 12:16:13 devstack sudo[112125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:13 devstack sudo[112125]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264" returned: 0 in 0.378s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:13 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264 Aug 26 12:16:13 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:13 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9574a722-cbdd-4f42-b2c5-13c86ac2e264" returned: 0 in 0.265s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-quobyte-9574a722-cbdd-4f42-b2c5-13c86ac2e264" released by "delete_volume" :: held 0.691s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Created reservations ['e6c6b2de-d0b4-4910-a96d-d941970df42c', 'c4d276e2-0022-484a-a293-763014c5dfed', 'dc9cd098-b4f5-4c8f-baee-18ecd3c0c446', '45d827b0-6dac-41ed-a6f3-d218b97425c3'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:13 devstack sudo[112134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:13 devstack sudo[112134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:14 devstack sudo[112134]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.257s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:14 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Deleted volume successfully. Aug 26 12:16:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e2e5f410-4bc0-46dd-99fb-e52daaf0e34a tempest-SnapshotDependencyTests-1007748680 None] Lock "cinder-9574a722-cbdd-4f42-b2c5-13c86ac2e264-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:23 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=76,cinder:UPDATE=104,cinder:DELETE=8,cinder:INSERT=23 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:16:24 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:UPDATE=109,cinder:SELECT=72,cinder:INSERT=27,cinder:DELETE=11 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (3928d885-a933-44c6-8ec0-3d735a69b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5e4586-a8b5-4d9f-ba47-8b512c1ee818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5e4586-a8b5-4d9f-ba47-8b512c1ee818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-701100024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f497dd-b72a-4e60-ac7b-e72faddc7ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:35Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2644ae5e-6819-493f-91b8-7c445af4080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2644ae5e-6819-493f-91b8-7c445af4080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f143737b-3921-4eb0-a024-8120b201cbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f143737b-3921-4eb0-a024-8120b201cbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f497dd-b72a-4e60-ac7b-e72faddc7ec8', 'volume_name': 'volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea4e060-48fc-4043-8ce3-92a31c9d6699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea4e060-48fc-4043-8ce3-92a31c9d6699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9174d65f-49a6-46ca-b17a-70d17cb407f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Volume 15f497dd-b72a-4e60-ac7b-e72faddc7ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8', 'volume_size': 1} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-701100024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f497dd-b72a-4e60-ac7b-e72faddc7ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:35Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Creating volume 15f497dd-b72a-4e60-ac7b-e72faddc7ec8 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:35 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:35 devstack sudo[112217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 1073741824 Aug 26 12:16:35 devstack sudo[112217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (07d90db3-23a7-4242-a8b9-7bf11652318f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fce5851-5445-4d57-8a61-a5d0eda6839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fce5851-5445-4d57-8a61-a5d0eda6839c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1615266845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427f2784-4aa2-412e-a56b-f7006ccb0869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:35Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c983b0-1a3e-4bb3-a8f1-e51961316760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c983b0-1a3e-4bb3-a8f1-e51961316760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a7abb7-1263-4581-a66c-91874f37e1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a7abb7-1263-4581-a66c-91874f37e1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427f2784-4aa2-412e-a56b-f7006ccb0869', 'volume_name': 'volume-427f2784-4aa2-412e-a56b-f7006ccb0869', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac3be90-69c4-485a-8efe-5bd618241e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac3be90-69c4-485a-8efe-5bd618241e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a7ccee-4aa2-430b-be59-bfae25d575ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:35 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume 427f2784-4aa2-412e-a56b-f7006ccb0869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427f2784-4aa2-412e-a56b-f7006ccb0869', 'volume_size': 1} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (60e7c5fd-dbba-4453-b841-40d826fe1957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:35 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cca73d-807f-4741-94d1-81f45546bc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cca73d-807f-4741-94d1-81f45546bc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1899023423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7eac65-fa79-45ad-9a63-4f6e2e8be70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:36Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74134d9b-3f85-49c1-91e2-797b60760438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74134d9b-3f85-49c1-91e2-797b60760438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa7c193-53de-4e63-b0ec-8686ba2527af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa7c193-53de-4e63-b0ec-8686ba2527af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f7eac65-fa79-45ad-9a63-4f6e2e8be70d', 'volume_name': 'volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696511dd-66d9-4e55-9635-f89287799c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696511dd-66d9-4e55-9635-f89287799c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a125c7db-7429-43c7-8052-c3e8117963b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Volume 8f7eac65-fa79-45ad-9a63-4f6e2e8be70d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d', 'volume_size': 1} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (be0c0ab8-3156-4641-8d66-973029e21e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd976771-dedc-4681-8395-7aadcd4ad93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd976771-dedc-4681-8395-7aadcd4ad93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114927499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d794743-6d05-4542-a78d-1c75340bb607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:36Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack sudo[112217]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91107ee-f67d-4e05-81c9-4be15a82610b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91107ee-f67d-4e05-81c9-4be15a82610b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca474d58-c7fb-494e-a533-2d1f93825c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca474d58-c7fb-494e-a533-2d1f93825c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d794743-6d05-4542-a78d-1c75340bb607', 'volume_name': 'volume-7d794743-6d05-4542-a78d-1c75340bb607', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d19c20-ceef-4ca6-a534-10d73b9be332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d19c20-ceef-4ca6-a534-10d73b9be332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6fa8a3-05cc-429a-baf7-a7a1aeff2d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Volume 7d794743-6d05-4542-a78d-1c75340bb607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d794743-6d05-4542-a78d-1c75340bb607', 'volume_size': 1} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 1073741824" returned: 0 in 0.685s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:36 devstack sudo[112224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 Aug 26 12:16:36 devstack sudo[112224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:36 devstack sudo[112224]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8" returned: 0 in 0.327s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.934s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1615266845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427f2784-4aa2-412e-a56b-f7006ccb0869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:35Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Creating volume 427f2784-4aa2-412e-a56b-f7006ccb0869 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:36 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9174d65f-49a6-46ca-b17a-70d17cb407f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack sudo[112227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 1073741824 Aug 26 12:16:36 devstack sudo[112227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d039c1-240d-4e41-ad5a-956c10771ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Volume volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 (15f497dd-b72a-4e60-ac7b-e72faddc7ec8): created successfully Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d039c1-240d-4e41-ad5a-956c10771ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (3928d885-a933-44c6-8ec0-3d735a69b597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fdb7ff40-9db5-4a49-800f-8a1ea287a308 tempest-CreateVolumesFromImageTest-892260736 None] Created volume successfully. Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (c01e1b12-1c61-4e4b-84a4-e58a2ba87c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334b5130-62c3-4828-9d50-e9fb3452e0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334b5130-62c3-4828-9d50-e9fb3452e0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209094343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9933ef90-b067-45a9-9d97-c4b4efd49060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:37Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf3f03e-d413-4c41-a3b2-bed615651eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf3f03e-d413-4c41-a3b2-bed615651eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d648bb5-901c-48ae-958b-24395a3ab65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d648bb5-901c-48ae-958b-24395a3ab65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9933ef90-b067-45a9-9d97-c4b4efd49060', 'volume_name': 'volume-9933ef90-b067-45a9-9d97-c4b4efd49060', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a127b0bc-2d7b-4463-844b-c1ae8cd2df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a127b0bc-2d7b-4463-844b-c1ae8cd2df64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9503cb99-77a6-4eba-84d3-d3ff72cbc72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Volume 9933ef90-b067-45a9-9d97-c4b4efd49060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9933ef90-b067-45a9-9d97-c4b4efd49060', 'volume_size': 1} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Flow 'volume_create_manager' (d36a959a-8e4b-4e37-83cd-7839862abd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168a399c-2830-450c-8191-2374602fee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168a399c-2830-450c-8191-2374602fee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345239828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac1e4cc-8f26-4f28-abdc-1554e0641f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dfc037f21b447e96b0dd522e4014e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:37Z,use_quota=True,user_id='9eb27b7c186648228ff4559fce5b6a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4101fd85-4e34-4337-b22c-617e3b6d6529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4101fd85-4e34-4337-b22c-617e3b6d6529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3bfa24-9740-43bf-8efe-2a05fae07663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3bfa24-9740-43bf-8efe-2a05fae07663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac1e4cc-8f26-4f28-abdc-1554e0641f3b', 'volume_name': 'volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f934e295-daf6-4a91-9dcd-cbef4cde2225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f934e295-daf6-4a91-9dcd-cbef4cde2225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532eea86-a62d-4e52-9d90-6bb18788f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Volume 4ac1e4cc-8f26-4f28-abdc-1554e0641f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b', 'volume_size': 1} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (8fe8f6f0-ab60-4681-8a32-a4450f993341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2984925b-13dc-45bb-8229-537d3d6e681a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2984925b-13dc-45bb-8229-537d3d6e681a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-693700099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53977e1a-11eb-423a-920c-f3a373b05e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:37Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2941ef66-3459-4646-8e6c-8083754f0b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2941ef66-3459-4646-8e6c-8083754f0b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack sudo[112227]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad7ec29-3b38-4950-bfe1-60c29a29fd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad7ec29-3b38-4950-bfe1-60c29a29fd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53977e1a-11eb-423a-920c-f3a373b05e51', 'volume_name': 'volume-53977e1a-11eb-423a-920c-f3a373b05e51', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e04ab69-710a-4490-9cae-ceb976125ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e04ab69-710a-4490-9cae-ceb976125ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d665f55-dd94-47c9-9c26-c4f6bc114cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Volume 53977e1a-11eb-423a-920c-f3a373b05e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53977e1a-11eb-423a-920c-f3a373b05e51', 'volume_size': 1} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 1073741824" returned: 0 in 0.580s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:37 devstack sudo[112234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 Aug 26 12:16:37 devstack sudo[112234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:37 devstack sudo[112234]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869" returned: 0 in 0.253s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1899023423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7eac65-fa79-45ad-9a63-4f6e2e8be70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:36Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Creating volume 8f7eac65-fa79-45ad-9a63-4f6e2e8be70d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:37 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a7ccee-4aa2-430b-be59-bfae25d575ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427f2784-4aa2-412e-a56b-f7006ccb0869', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35983404-0e96-417b-9b37-dec4e47b1351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:37 devstack sudo[112237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d 1073741824 Aug 26 12:16:37 devstack sudo[112237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:37 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume volume-427f2784-4aa2-412e-a56b-f7006ccb0869 (427f2784-4aa2-412e-a56b-f7006ccb0869): created successfully Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35983404-0e96-417b-9b37-dec4e47b1351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (07d90db3-23a7-4242-a8b9-7bf11652318f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:37 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-766ea7d1-0cca-4497-a12b-b434f79bf3f7 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created volume successfully. Aug 26 12:16:37 devstack sudo[112237]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d 1073741824" returned: 0 in 0.444s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:38 devstack sudo[112243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d Aug 26 12:16:38 devstack sudo[112243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:38 devstack sudo[112243]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.043s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114927499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d794743-6d05-4542-a78d-1c75340bb607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:36Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Creating volume 7d794743-6d05-4542-a78d-1c75340bb607 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:38 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a125c7db-7429-43c7-8052-c3e8117963b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:38 devstack sudo[112246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607 1073741824 Aug 26 12:16:38 devstack sudo[112246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b74317-93e2-416e-953d-8ccd7babb09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:38 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Volume volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d (8f7eac65-fa79-45ad-9a63-4f6e2e8be70d): created successfully Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b74317-93e2-416e-953d-8ccd7babb09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (60e7c5fd-dbba-4453-b841-40d826fe1957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:38 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5e97064c-88a6-4c91-9c52-de7719290cb4 tempest-CreateVolumesFromImageTest-892260736 None] Created volume successfully. Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:38 devstack sudo[112246]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607 1073741824" returned: 0 in 0.514s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:38 devstack sudo[112252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607 Aug 26 12:16:38 devstack sudo[112252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:39 devstack sudo[112252]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607" returned: 0 in 0.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.240s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209094343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9933ef90-b067-45a9-9d97-c4b4efd49060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:37Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Creating volume 9933ef90-b067-45a9-9d97-c4b4efd49060 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:39 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6fa8a3-05cc-429a-baf7-a7a1aeff2d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d794743-6d05-4542-a78d-1c75340bb607', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb11d25f-f245-41f4-92eb-56b23ebacde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:39 devstack sudo[112261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060 1073741824 Aug 26 12:16:39 devstack sudo[112261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:39 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Volume volume-7d794743-6d05-4542-a78d-1c75340bb607 (7d794743-6d05-4542-a78d-1c75340bb607): created successfully Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb11d25f-f245-41f4-92eb-56b23ebacde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (be0c0ab8-3156-4641-8d66-973029e21e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0d85a766-6677-4e47-9274-526f2ab22987 tempest-CreateVolumesFromImageTest-892260736 None] Created volume successfully. Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Flow 'volume_create_manager' (7692400a-07f7-4cfa-9146-d768f98e02b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d5e3b0-335b-4cae-922b-bfeff6693200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d5e3b0-335b-4cae-922b-bfeff6693200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a68c73-ca42-43d9-a6ce-5665f6a73afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f110e880e3ec4842ab7e1249cb7fa801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:39Z,use_quota=True,user_id='5e22b6d1ab284eb2907894f82cf10d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbc81de5-50bc-4c45-90c8-f977919be9c2),volume_type_id=dbc81de5-50bc-4c45-90c8-f977919be9c2)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58a532a-61e7-477e-9d28-48d2dd44d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58a532a-61e7-477e-9d28-48d2dd44d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9440032-fda0-469a-90a0-2cbf336bc515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:16:39 devstack sudo[112261]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060 1073741824" returned: 0 in 0.492s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:39 devstack sudo[112267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060 Aug 26 12:16:39 devstack sudo[112267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9440032-fda0-469a-90a0-2cbf336bc515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53a68c73-ca42-43d9-a6ce-5665f6a73afb', 'volume_name': 'volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb', 'volume_size': 1, 'image_id': 'f16b88e4-d199-4e1d-a40b-882c67588909', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f16b88e4-d199-4e1d-a40b-882c67588909', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a360eead3eeb765900e13e0c80c8e06a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f110e880e3ec4842ab7e1249cb7fa801', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee6a7374f9ddff214d382f80138d730fddac8a71076282dce10048a1ee720f3b3171252a4eda76c5661574cd1de875f5e7cabf16e46ec274a174f05f2634d214', 'id': 'f16b88e4-d199-4e1d-a40b-882c67588909', 'created_at': datetime.datetime(2026, 8, 26, 10, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f16b88e4-d199-4e1d-a40b-882c67588909/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933d4ee8-88e5-4ef6-92d6-60ce2163c4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933d4ee8-88e5-4ef6-92d6-60ce2163c4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c884522f-81d2-4805-bc6b-bf2129a9488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:39 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Volume 53a68c73-ca42-43d9-a6ce-5665f6a73afb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb', 'volume_size': 1, 'image_id': 'f16b88e4-d199-4e1d-a40b-882c67588909', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f16b88e4-d199-4e1d-a40b-882c67588909', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a360eead3eeb765900e13e0c80c8e06a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f110e880e3ec4842ab7e1249cb7fa801', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee6a7374f9ddff214d382f80138d730fddac8a71076282dce10048a1ee720f3b3171252a4eda76c5661574cd1de875f5e7cabf16e46ec274a174f05f2634d214', 'id': 'f16b88e4-d199-4e1d-a40b-882c67588909', 'created_at': datetime.datetime(2026, 8, 26, 10, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f16b88e4-d199-4e1d-a40b-882c67588909/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Trying to clone 53a68c73-ca42-43d9-a6ce-5665f6a73afb from image f16b88e4-d199-4e1d-a40b-882c67588909 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f16b88e4-d199-4e1d-a40b-882c67588909', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:16:39 devstack sudo[112267]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060" returned: 0 in 0.259s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.813s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345239828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac1e4cc-8f26-4f28-abdc-1554e0641f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dfc037f21b447e96b0dd522e4014e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:37Z,use_quota=True,user_id='9eb27b7c186648228ff4559fce5b6a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Creating volume 4ac1e4cc-8f26-4f28-abdc-1554e0641f3b {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:39 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9503cb99-77a6-4eba-84d3-d3ff72cbc72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9933ef90-b067-45a9-9d97-c4b4efd49060', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:39 devstack sudo[112270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b 1073741824 Aug 26 12:16:39 devstack sudo[112270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0301fe-f016-4a7a-ba34-faf631e07fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:16:39 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Image download 0.00 MB at 0.00 MB/s Aug 26 12:16:39 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Volume volume-9933ef90-b067-45a9-9d97-c4b4efd49060 (9933ef90-b067-45a9-9d97-c4b4efd49060): created successfully Aug 26 12:16:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0301fe-f016-4a7a-ba34-faf631e07fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (c01e1b12-1c61-4e4b-84a4-e58a2ba87c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2a3d6b0a-6cb4-4c7b-80be-c9411610aaa9 tempest-CreateVolumesFromImageTest-892260736 None] Created volume successfully. Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92f37fc-4d10-4677-a236-12792de2be90]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:40 devstack sudo[112272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD Aug 26 12:16:40 devstack sudo[112272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:40 devstack sudo[112270]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b 1073741824" returned: 0 in 0.428s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:40 devstack sudo[112272]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:40 devstack sudo[112279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b Aug 26 12:16:40 devstack sudo[112279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:40 devstack sudo[112280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD Aug 26 12:16:40 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:40 devstack sudo[112279]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.492s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-693700099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53977e1a-11eb-423a-920c-f3a373b05e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f98e752194d50937e257faec687e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:37Z,use_quota=True,user_id='9e327301b58b44bfb11db49aa54c81f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Creating volume 53977e1a-11eb-423a-920c-f3a373b05e51 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:40 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532eea86-a62d-4e52-9d90-6bb18788f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:40 devstack sudo[112285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51 1073741824 Aug 26 12:16:40 devstack sudo[112285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490b4717-bffc-4285-afd6-f8a6fe1c2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:40 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Temporary image f16b88e4-d199-4e1d-a40b-882c67588909 is fetched for user 5e22b6d1ab284eb2907894f82cf10d1a. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:16:40 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Volume volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b (4ac1e4cc-8f26-4f28-abdc-1554e0641f3b): created successfully Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490b4717-bffc-4285-afd6-f8a6fe1c2b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Flow 'volume_create_manager' (d36a959a-8e4b-4e37-83cd-7839862abd41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2400d046-a29a-43a4-9440-86bef6567f78 tempest-ProjectReaderTests-1109116477 None] Created volume successfully. Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a657e0ce-1646-446e-9f9e-ef2802646878]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:40 devstack sudo[112289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD Aug 26 12:16:40 devstack sudo[112289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:41 devstack sudo[112285]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51 1073741824" returned: 0 in 0.445s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:41 devstack sudo[112289]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:41 devstack sudo[112298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51 Aug 26 12:16:41 devstack sudo[112298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:41 devstack sudo[112296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD Aug 26 12:16:41 devstack sudo[112296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:41 devstack sudo[112298]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51" returned: 0 in 0.264s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.961s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:41 devstack sudo[112296]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Creating offline snapshot 05ec008c-42e4-4300-9a66-00cbb5f7ad1b of volume 427f2784-4aa2-412e-a56b-f7006ccb0869 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d665f55-dd94-47c9-9c26-c4f6bc114cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53977e1a-11eb-423a-920c-f3a373b05e51', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e86cd07-ee38-403e-a763-1a4d1a2d84f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d723738b-cfc2-48a1-b038-abe98576b92c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:41 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Volume volume-53977e1a-11eb-423a-920c-f3a373b05e51 (53977e1a-11eb-423a-920c-f3a373b05e51): created successfully Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e86cd07-ee38-403e-a763-1a4d1a2d84f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Flow 'volume_create_manager' (8fe8f6f0-ab60-4681-8a32-a4450f993341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:41 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c3ce0acc-688f-4d89-8423-f927b54f2d6c tempest-CreateVolumesFromImageTest-892260736 None] Created volume successfully. Aug 26 12:16:41 devstack sudo[112305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 Aug 26 12:16:41 devstack sudo[112305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:41 devstack sudo[112305]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869" returned: 0 in 0.370s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Acquiring lock "cinder-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:41 devstack sudo[112310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b 1G Aug 26 12:16:41 devstack sudo[112310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Lock "cinder-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Acquiring lock "cinder-quobyte-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Lock "cinder-quobyte-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b" acquired by "delete_volume" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8d06ed-e95f-48ea-871c-943d7a95e52e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:42 devstack sudo[112312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b Aug 26 12:16:42 devstack sudo[112312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-53977e1a-11eb-423a-920c-f3a373b05e51-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-53977e1a-11eb-423a-920c-f3a373b05e51-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:42 devstack sudo[112310]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b 1G" returned: 0 in 0.499s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-427f2784-4aa2-412e-a56b-f7006ccb0869 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:42 devstack sudo[112312]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b" returned: 0 in 0.400s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:42 devstack sudo[112320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-427f2784-4aa2-412e-a56b-f7006ccb0869 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b Aug 26 12:16:42 devstack sudo[112320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-quobyte-53977e1a-11eb-423a-920c-f3a373b05e51" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:42 devstack sudo[112321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b Aug 26 12:16:42 devstack sudo[112321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-53977e1a-11eb-423a-920c-f3a373b05e51" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9302911b-f31b-4688-bff8-75bc66e3bb23]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:42 devstack sudo[112324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51 Aug 26 12:16:42 devstack sudo[112324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:42 devstack sudo[112321]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b" returned: 0 in 0.325s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:42 devstack sudo[112320]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-427f2784-4aa2-412e-a56b-f7006ccb0869 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b" returned: 0 in 0.357s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:42 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b is being set with open permissions: ugo+rw Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Lock "cinder-quobyte-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b" released by "delete_volume" :: held 0.778s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:42 devstack sudo[112330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b Aug 26 12:16:42 devstack sudo[112330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Created reservations ['80279437-4527-438c-8083-fcd26783489e', '32df804c-0bc2-44cc-adb5-a8a09c7a53a2', '314a539c-9765-46b4-9c9f-8756d98f92be', '841187cd-c0cd-4584-80ad-b3a78ff223d7'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:42 devstack sudo[112324]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51" returned: 0 in 0.438s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:42 devstack sudo[112336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:42 devstack sudo[112336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:42 devstack sudo[112338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51 Aug 26 12:16:42 devstack sudo[112338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:43 devstack sudo[112330]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b" returned: 0 in 0.301s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:43 devstack sudo[112341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.info Aug 26 12:16:43 devstack sudo[112341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:43 devstack sudo[112336]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.303s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Deleted volume successfully. Aug 26 12:16:43 devstack sudo[112338]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53977e1a-11eb-423a-920c-f3a373b05e51" returned: 0 in 0.293s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-53977e1a-11eb-423a-920c-f3a373b05e51" released by "delete_volume" :: held 0.787s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b9979d3e-2a35-441a-98e9-e197722347ac tempest-ProjectReaderTests-1109116477 None] Lock "cinder-4ac1e4cc-8f26-4f28-abdc-1554e0641f3b-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Created reservations ['fa047bf2-b6c8-4044-95de-c110f3d5c63d', '71994c09-2476-48d5-bb37-98c8027375c8', '40f1028b-587c-4aa5-aaa8-18d9d5415d17', 'e0071d6c-c5c2-4e0b-80f7-2cdf4a66b2b8'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:43 devstack sudo[112341]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.info" returned: 0 in 0.281s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:43 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.info is being set with open permissions: ugo+rw Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:43 devstack sudo[112346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.info Aug 26 12:16:43 devstack sudo[112346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:43 devstack sudo[112348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:43 devstack sudo[112348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-9933ef90-b067-45a9-9d97-c4b4efd49060-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-9933ef90-b067-45a9-9d97-c4b4efd49060-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-quobyte-9933ef90-b067-45a9-9d97-c4b4efd49060" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Flow 'volume_create_manager' (52dbc0a2-d248-462d-bda8-6fe31adbbc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296dd4a9-f74d-4fe8-8104-4948de4ed247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-9933ef90-b067-45a9-9d97-c4b4efd49060" acquired by "delete_volume" :: waited 0.056s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296dd4a9-f74d-4fe8-8104-4948de4ed247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16511db1-550f-46a9-82e5-354983c6bad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dfc037f21b447e96b0dd522e4014e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:44Z,use_quota=True,user_id='9eb27b7c186648228ff4559fce5b6a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d116102-bbf6-4a71-aeaf-42b1af69a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d116102-bbf6-4a71-aeaf-42b1af69a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c38f181-3f13-472d-8772-06b18a97f0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c38f181-3f13-472d-8772-06b18a97f0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16511db1-550f-46a9-82e5-354983c6bad7', 'volume_name': 'volume-16511db1-550f-46a9-82e5-354983c6bad7', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028ad1a7-7318-4335-be5c-07c313c25eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028ad1a7-7318-4335-be5c-07c313c25eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:43 devstack sudo[112346]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0f1cf1-5aed-4fd2-84d2-16a0bd3581a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:43 devstack sudo[112348]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:43 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Volume 16511db1-550f-46a9-82e5-354983c6bad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16511db1-550f-46a9-82e5-354983c6bad7', 'volume_size': 1} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aaa055-6640-4369-8d91-99c7e1ec2503]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.info" returned: 0 in 0.440s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.391s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.344s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a68c73-ca42-43d9-a6ce-5665f6a73afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f110e880e3ec4842ab7e1249cb7fa801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:39Z,use_quota=True,user_id='5e22b6d1ab284eb2907894f82cf10d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbc81de5-50bc-4c45-90c8-f977919be9c2),volume_type_id=dbc81de5-50bc-4c45-90c8-f977919be9c2)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Creating volume 53a68c73-ca42-43d9-a6ce-5665f6a73afb {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:43 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Deleted volume successfully. Aug 26 12:16:43 devstack sudo[112355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb 1073741824 Aug 26 12:16:43 devstack sudo[112355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-30e93781-3f26-4c58-9453-00fda817f3b9 tempest-CreateVolumesFromSnapshotTest-840300471 None] Create snapshot completed successfully Aug 26 12:16:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-67373e69-5d59-4180-9399-a109b701f172 tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-53977e1a-11eb-423a-920c-f3a373b05e51-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:43 devstack sudo[112354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060 Aug 26 12:16:43 devstack sudo[112354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:44 devstack sudo[112354]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060" returned: 0 in 0.384s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:44 devstack sudo[112365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060 Aug 26 12:16:44 devstack sudo[112365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:44 devstack sudo[112355]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb 1073741824" returned: 0 in 0.443s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:44 devstack sudo[112367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb Aug 26 12:16:44 devstack sudo[112367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:44 devstack sudo[112365]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9933ef90-b067-45a9-9d97-c4b4efd49060" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-9933ef90-b067-45a9-9d97-c4b4efd49060" released by "delete_volume" :: held 0.746s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Created reservations ['e99ba568-db1c-4900-8644-ec329c84c562', 'fa261dec-61dd-4a82-ab2c-bcd6249f73bd', '0d9cfff0-8a80-4281-b856-ef15ee636afe', 'dfe2249f-a266-4653-926f-67c39d00a050'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:44 devstack sudo[112367]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb" returned: 0 in 0.266s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.795s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16511db1-550f-46a9-82e5-354983c6bad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dfc037f21b447e96b0dd522e4014e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:44Z,use_quota=True,user_id='9eb27b7c186648228ff4559fce5b6a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Creating volume 16511db1-550f-46a9-82e5-354983c6bad7 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:44 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:44 devstack sudo[112371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7 1073741824 Aug 26 12:16:44 devstack sudo[112371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Attempting download of f16b88e4-d199-4e1d-a40b-882c67588909 ((None, [{'url': 'file:///opt/stack/data/glance/images/f16b88e4-d199-4e1d-a40b-882c67588909', 'metadata': {}}])) to volume 53a68c73-ca42-43d9-a6ce-5665f6a73afb. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:16:44 devstack sudo[112373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:44 devstack sudo[112373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d34e96d-be2d-4402-bdc7-9441b091d05e]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f16b88e4-d199-4e1d-a40b-882c67588909__h9vxcl7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-7d794743-6d05-4542-a78d-1c75340bb607-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-7d794743-6d05-4542-a78d-1c75340bb607-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-quobyte-7d794743-6d05-4542-a78d-1c75340bb607" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-7d794743-6d05-4542-a78d-1c75340bb607" acquired by "delete_volume" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:44 devstack sudo[112375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f16b88e4-d199-4e1d-a40b-882c67588909__h9vxcl7 Aug 26 12:16:44 devstack sudo[112375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc6a81-b612-42a7-ae36-8c5ae6d2c4b6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:45 devstack sudo[112373]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.400s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:45 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Deleted volume successfully. Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a23a0614-61de-4ecd-8d97-4aad02943e6d tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-9933ef90-b067-45a9-9d97-c4b4efd49060-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:45 devstack sudo[112380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607 Aug 26 12:16:45 devstack sudo[112380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:45 devstack sudo[112375]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f16b88e4-d199-4e1d-a40b-882c67588909__h9vxcl7" returned: 0 in 0.533s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f16b88e4-d199-4e1d-a40b-882c67588909__h9vxcl7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:45 devstack sudo[112371]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7 1073741824" returned: 0 in 0.742s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (720b09dc-9813-4bca-9154-fcef853461ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ac547f-790e-4684-8410-2c79ab1794e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:45 devstack sudo[112386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f16b88e4-d199-4e1d-a40b-882c67588909__h9vxcl7 Aug 26 12:16:45 devstack sudo[112386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ac547f-790e-4684-8410-2c79ab1794e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-319559995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae746a2-876b-41ba-8b6f-8ab5df5843f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:45Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2077dd-dc1b-4590-a756-64180bf833c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2077dd-dc1b-4590-a756-64180bf833c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa36d07-8886-49cd-9256-34cf6bfaa9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa36d07-8886-49cd-9256-34cf6bfaa9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae746a2-876b-41ba-8b6f-8ab5df5843f5', 'volume_name': 'volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2555f79-c698-4ec6-852b-1a83315f7a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2555f79-c698-4ec6-852b-1a83315f7a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d76039b-9cf0-4f41-af86-1a09c50623e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:45 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume 5ae746a2-876b-41ba-8b6f-8ab5df5843f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5', 'volume_size': 1} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:45 devstack sudo[112380]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607" returned: 0 in 0.503s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:45 devstack sudo[112391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7 Aug 26 12:16:45 devstack sudo[112391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:45 devstack sudo[112392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607 Aug 26 12:16:45 devstack sudo[112392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:45 devstack sudo[112386]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f16b88e4-d199-4e1d-a40b-882c67588909__h9vxcl7" returned: 1 in 0.427s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f16b88e4-d199-4e1d-a40b-882c67588909__h9vxcl7' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a1655-bdd9-4b6a-97e6-f9eb3642d795]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:45 devstack sudo[112391]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7" returned: 0 in 0.319s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-319559995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae746a2-876b-41ba-8b6f-8ab5df5843f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:45Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Creating volume 5ae746a2-876b-41ba-8b6f-8ab5df5843f5 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:45 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:45 devstack sudo[112397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD Aug 26 12:16:45 devstack sudo[112397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0f1cf1-5aed-4fd2-84d2-16a0bd3581a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16511db1-550f-46a9-82e5-354983c6bad7', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:45 devstack sudo[112400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 1073741824 Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4b5d26-cc7a-47c7-8606-41d8b8d60e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:45 devstack sudo[112400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:45 devstack sudo[112392]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:45 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Volume volume-16511db1-550f-46a9-82e5-354983c6bad7 (16511db1-550f-46a9-82e5-354983c6bad7): created successfully Aug 26 12:16:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4b5d26-cc7a-47c7-8606-41d8b8d60e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Flow 'volume_create_manager' (52dbc0a2-d248-462d-bda8-6fe31adbbc1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7d794743-6d05-4542-a78d-1c75340bb607" returned: 0 in 0.507s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c047992f-581e-4a46-a9f9-346554038f6d tempest-ProjectReaderTests-1109116477 None] Created volume successfully. Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-7d794743-6d05-4542-a78d-1c75340bb607" released by "delete_volume" :: held 1.123s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (7a0a618d-d20c-4aa8-a853-a908bb9ef073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17c3012-7c47-4502-821a-bd64c7f35df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17c3012-7c47-4502-821a-bd64c7f35df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1725795085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b94a0a-2811-42a7-b35c-415231ce2234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:46Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde0fa4d-5a33-4f08-8cf1-e17f87344d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde0fa4d-5a33-4f08-8cf1-e17f87344d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35838c0e-2165-4141-b32b-cbb856bfcbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35838c0e-2165-4141-b32b-cbb856bfcbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b94a0a-2811-42a7-b35c-415231ce2234', 'volume_name': 'volume-57b94a0a-2811-42a7-b35c-415231ce2234', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4b659f-1cc9-48c2-8346-d7a4f1f63749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4b659f-1cc9-48c2-8346-d7a4f1f63749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e161ff-9909-405b-9218-f5ca92f7672c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume 57b94a0a-2811-42a7-b35c-415231ce2234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b94a0a-2811-42a7-b35c-415231ce2234', 'volume_size': 1} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:46 devstack sudo[112397]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Created reservations ['0f8d8871-2cb5-4a15-8568-b48f9cb4c015', '395073f6-2bdf-4b23-a960-fc961de6215e', '1d7e9623-aa7f-40d3-b105-b3871b999fd1', 'b70a69db-2b39-43fc-aaec-337e018e9749'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:46 devstack sudo[112409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD Aug 26 12:16:46 devstack sudo[112409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:46 devstack sudo[112411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:46 devstack sudo[112411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:46 devstack sudo[112400]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 1073741824" returned: 0 in 0.624s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (fa703d7d-879a-455b-b43a-47e40f3758bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4061e80f-3014-4a0f-bfec-2856613277ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4061e80f-3014-4a0f-bfec-2856613277ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-87855987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cb4e65-d34e-4cae-bc35-737d8e93e851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:46Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1079a998-5c4e-41da-880c-cb2f6083ab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1079a998-5c4e-41da-880c-cb2f6083ab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f747900e-ddf6-4c9d-9045-346c88ff9404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f747900e-ddf6-4c9d-9045-346c88ff9404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39cb4e65-d34e-4cae-bc35-737d8e93e851', 'volume_name': 'volume-39cb4e65-d34e-4cae-bc35-737d8e93e851', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a393a9b-398a-4612-b15a-cbcba3173433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a393a9b-398a-4612-b15a-cbcba3173433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26716e2b-9ee7-48f5-9301-9a1d4c72f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume 39cb4e65-d34e-4cae-bc35-737d8e93e851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39cb4e65-d34e-4cae-bc35-737d8e93e851', 'volume_size': 1} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:46 devstack sudo[112417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 Aug 26 12:16:46 devstack sudo[112417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:46 devstack sudo[112409]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] f16b88e4-d199-4e1d-a40b-882c67588909 was raw, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:46 devstack sudo[112411]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.368s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Deleted volume successfully. Aug 26 12:16:46 devstack sudo[112420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb Aug 26 12:16:46 devstack sudo[112420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-b596bfe3-ac36-4ed0-a4d6-b9be6d9c7edc tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-7d794743-6d05-4542-a78d-1c75340bb607-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (ce819e26-0418-4437-b484-20be283bb7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb80a07-8439-473d-a2f1-9a3d6446cc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb80a07-8439-473d-a2f1-9a3d6446cc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228312378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5425f1e-fed4-4f80-89b0-811c6df3a24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:47Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4041ce-868e-487f-9b7e-a141995587b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4041ce-868e-487f-9b7e-a141995587b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df6775b-b754-49e6-afe9-a124b05815f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:46 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df6775b-b754-49e6-afe9-a124b05815f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5425f1e-fed4-4f80-89b0-811c6df3a24d', 'volume_name': 'volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306a25f5-2df8-4d39-968e-6f37c50600bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306a25f5-2df8-4d39-968e-6f37c50600bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fedd5ef-eb01-4711-b839-19b57d282459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:47 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume a5425f1e-fed4-4f80-89b0-811c6df3a24d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d', 'volume_size': 1} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Acquiring lock "cinder-16511db1-550f-46a9-82e5-354983c6bad7-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Lock "cinder-16511db1-550f-46a9-82e5-354983c6bad7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:47 devstack sudo[112417]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5" returned: 0 in 0.444s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1725795085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b94a0a-2811-42a7-b35c-415231ce2234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:46Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Creating volume 57b94a0a-2811-42a7-b35c-415231ce2234 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:47 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d76039b-9cf0-4f41-af86-1a09c50623e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:47 devstack sudo[112426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234 1073741824 Aug 26 12:16:47 devstack sudo[112426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2ec072-69b5-4ed2-ad64-9f2d8bbcefb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Acquiring lock "cinder-quobyte-16511db1-550f-46a9-82e5-354983c6bad7" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:47 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 (5ae746a2-876b-41ba-8b6f-8ab5df5843f5): created successfully Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2ec072-69b5-4ed2-ad64-9f2d8bbcefb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (720b09dc-9813-4bca-9154-fcef853461ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Lock "cinder-quobyte-16511db1-550f-46a9-82e5-354983c6bad7" acquired by "delete_volume" :: waited 0.046s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:47 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0239f234-af46-4457-9d99-55b72af64346 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created volume successfully. Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a877725-7d9e-4bda-83a4-468f67ea13e4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-quobyte-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d" acquired by "delete_volume" :: waited 0.058s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:47 devstack sudo[112428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7 Aug 26 12:16:47 devstack sudo[112428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ee183-4aae-4933-b06f-e7424a104910]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:47 devstack sudo[112420]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb" returned: 0 in 0.888s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f16b88e4-d199-4e1d-a40b-882c67588909_hqgftg1adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:16:47 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:47 devstack sudo[112433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d Aug 26 12:16:47 devstack sudo[112433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:47 devstack sudo[112435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb 1G Aug 26 12:16:47 devstack sudo[112435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (1fd24c40-77a4-4409-8fd2-6dd6069e2fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597be763-f84c-49b6-95a9-cb037df621b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597be763-f84c-49b6-95a9-cb037df621b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2125794408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bf34e6-371b-4fef-9557-ab9ebfb1c78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:48Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26849f0d-1882-4308-98c6-675bb5d68580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26849f0d-1882-4308-98c6-675bb5d68580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb38479b-8266-4926-9d2e-ee452d98c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb38479b-8266-4926-9d2e-ee452d98c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bf34e6-371b-4fef-9557-ab9ebfb1c78d', 'volume_name': 'volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90458bf1-85dd-4eb3-85d0-2b05c35fe650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90458bf1-85dd-4eb3-85d0-2b05c35fe650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144be58f-8f34-4bb9-a47f-7387cd378811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:47 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume d4bf34e6-371b-4fef-9557-ab9ebfb1c78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d', 'volume_size': 1} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:47 devstack sudo[112428]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7" returned: 0 in 0.608s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:47 devstack sudo[112446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7 Aug 26 12:16:47 devstack sudo[112446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:47 devstack sudo[112426]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234 1073741824" returned: 0 in 0.832s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:47 devstack sudo[112433]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d" returned: 0 in 0.484s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:47 devstack sudo[112452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d Aug 26 12:16:47 devstack sudo[112452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:48 devstack sudo[112453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234 Aug 26 12:16:48 devstack sudo[112453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:48 devstack sudo[112435]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb 1G" returned: 0 in 0.446s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Downloaded image f16b88e4-d199-4e1d-a40b-882c67588909 ((None, [{'url': 'file:///opt/stack/data/glance/images/f16b88e4-d199-4e1d-a40b-882c67588909', 'metadata': {}}])) to volume 53a68c73-ca42-43d9-a6ce-5665f6a73afb successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Temporary image f16b88e4-d199-4e1d-a40b-882c67588909 for user 5e22b6d1ab284eb2907894f82cf10d1a is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Marking volume 53a68c73-ca42-43d9-a6ce-5665f6a73afb as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Copying metadata from image f16b88e4-d199-4e1d-a40b-882c67588909 to 53a68c73-ca42-43d9-a6ce-5665f6a73afb. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Creating volume glance metadata for volume 53a68c73-ca42-43d9-a6ce-5665f6a73afb backed by image f16b88e4-d199-4e1d-a40b-882c67588909 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f16b88e4-d199-4e1d-a40b-882c67588909', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a360eead3eeb765900e13e0c80c8e06a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:16:48 devstack sudo[112446]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-16511db1-550f-46a9-82e5-354983c6bad7" returned: 0 in 0.314s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c884522f-81d2-4805-bc6b-bf2129a9488f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb', 'volume_size': 1, 'image_id': 'f16b88e4-d199-4e1d-a40b-882c67588909', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f16b88e4-d199-4e1d-a40b-882c67588909', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a360eead3eeb765900e13e0c80c8e06a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f110e880e3ec4842ab7e1249cb7fa801', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee6a7374f9ddff214d382f80138d730fddac8a71076282dce10048a1ee720f3b3171252a4eda76c5661574cd1de875f5e7cabf16e46ec274a174f05f2634d214', 'id': 'f16b88e4-d199-4e1d-a40b-882c67588909', 'created_at': datetime.datetime(2026, 8, 26, 10, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f16b88e4-d199-4e1d-a40b-882c67588909/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3b6c72-f8be-48c9-9104-7a89a21bc1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Lock "cinder-quobyte-16511db1-550f-46a9-82e5-354983c6bad7" released by "delete_volume" :: held 1.014s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:48 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Volume volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb (53a68c73-ca42-43d9-a6ce-5665f6a73afb): created successfully Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3b6c72-f8be-48c9-9104-7a89a21bc1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Flow 'volume_create_manager' (7692400a-07f7-4cfa-9146-d768f98e02b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:48 devstack sudo[112452]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d" returned: 0 in 0.312s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-474140a2-c2c7-4e1e-beb7-341d43390c09 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Created volume successfully. Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d" released by "delete_volume" :: held 0.894s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:48 devstack sudo[112453]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234" returned: 0 in 0.331s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.718s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-87855987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cb4e65-d34e-4cae-bc35-737d8e93e851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:46Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Creating volume 39cb4e65-d34e-4cae-bc35-737d8e93e851 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:48 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Created reservations ['505c507e-f81d-4a3a-9bf6-95a6b7e4d4cd', '8b886673-f599-400c-b078-f8ce1dc9d02f', '3ae2507f-f700-49b1-8ec6-30d5dd869b3d', '1831282b-0286-4746-9094-22bd624f50a8'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:48 devstack sudo[112460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 1073741824 Aug 26 12:16:48 devstack sudo[112460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e161ff-9909-405b-9218-f5ca92f7672c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b94a0a-2811-42a7-b35c-415231ce2234', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc5e0de-68c9-43fe-a282-6602acfc7079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:48 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume volume-57b94a0a-2811-42a7-b35c-415231ce2234 (57b94a0a-2811-42a7-b35c-415231ce2234): created successfully Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc5e0de-68c9-43fe-a282-6602acfc7079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (7a0a618d-d20c-4aa8-a853-a908bb9ef073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Created reservations ['6b279de9-2a93-4e0a-8632-56cfed3d3758', '215adf08-5491-44a3-a845-858f9609b556', '97aea27e-cf1c-49bb-97ec-be57a6b9d58a', '68cd33cb-775f-449b-b4b9-bd9ce9f71807'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-31ad0f99-3a72-4e7b-9874-7e84eb9c9181 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created volume successfully. Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:48 devstack sudo[112462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:48 devstack sudo[112462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:48 devstack sudo[112465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:48 devstack sudo[112465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:48 devstack sudo[112462]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.280s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Deleted volume successfully. Aug 26 12:16:48 devstack sudo[112460]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 1073741824" returned: 0 in 0.473s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-caf83a16-914b-4739-bef3-5fd20dad68b8 tempest-ProjectReaderTests-1109116477 None] Lock "cinder-16511db1-550f-46a9-82e5-354983c6bad7-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:48 devstack sudo[112465]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.307s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:48 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Deleted volume successfully. Aug 26 12:16:48 devstack sudo[112475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 Aug 26 12:16:48 devstack sudo[112475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8930d603-bd8f-4e1b-83f0-63ac87f568ae tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-8f7eac65-fa79-45ad-9a63-4f6e2e8be70d-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:49 devstack sudo[112475]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851" returned: 0 in 0.246s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.073s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228312378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5425f1e-fed4-4f80-89b0-811c6df3a24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:47Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Creating volume a5425f1e-fed4-4f80-89b0-811c6df3a24d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:49 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26716e2b-9ee7-48f5-9301-9a1d4c72f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39cb4e65-d34e-4cae-bc35-737d8e93e851', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:49 devstack sudo[112478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d 1073741824 Aug 26 12:16:49 devstack sudo[112478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246c3479-f852-413d-992d-1f643f642516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:49 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 (39cb4e65-d34e-4cae-bc35-737d8e93e851): created successfully Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246c3479-f852-413d-992d-1f643f642516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (fa703d7d-879a-455b-b43a-47e40f3758bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-87c9f5e0-a6f3-42c0-b001-db358329ad97 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created volume successfully. Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Acquiring lock "cinder-53a68c73-ca42-43d9-a6ce-5665f6a73afb-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "cinder-53a68c73-ca42-43d9-a6ce-5665f6a73afb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Acquiring lock "cinder-quobyte-53a68c73-ca42-43d9-a6ce-5665f6a73afb" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "cinder-quobyte-53a68c73-ca42-43d9-a6ce-5665f6a73afb" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b039e400-61b5-4ec9-88e6-687e9ff01356]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-15f497dd-b72a-4e60-ac7b-e72faddc7ec8-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-15f497dd-b72a-4e60-ac7b-e72faddc7ec8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:49 devstack sudo[112478]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:49 devstack sudo[112484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb Aug 26 12:16:49 devstack sudo[112484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d 1073741824" returned: 0 in 0.564s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "cinder-quobyte-15f497dd-b72a-4e60-ac7b-e72faddc7ec8" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-15f497dd-b72a-4e60-ac7b-e72faddc7ec8" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2086d7f3-3df0-4384-b2ae-e27d7c786231]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:49 devstack sudo[112488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d Aug 26 12:16:49 devstack sudo[112488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:49 devstack sudo[112487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 Aug 26 12:16:49 devstack sudo[112487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:49 devstack sudo[112484]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb" returned: 0 in 0.491s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:50 devstack sudo[112495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb Aug 26 12:16:50 devstack sudo[112495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:50 devstack sudo[112488]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d" returned: 0 in 0.325s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.269s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2125794408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bf34e6-371b-4fef-9557-ab9ebfb1c78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5260003f6234fb5bb4d82139a424942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:48Z,use_quota=True,user_id='24825628d76841948e9e46775825aed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Creating volume d4bf34e6-371b-4fef-9557-ab9ebfb1c78d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:50 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fedd5ef-eb01-4711-b839-19b57d282459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:50 devstack sudo[112498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d 1073741824 Aug 26 12:16:50 devstack sudo[112498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80360e3-fea3-446a-8d40-b673d30c679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:50 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d (a5425f1e-fed4-4f80-89b0-811c6df3a24d): created successfully Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80360e3-fea3-446a-8d40-b673d30c679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (ce819e26-0418-4437-b484-20be283bb7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d2dc8a66-4947-4bd3-bb46-0fb0db735b23 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created volume successfully. Aug 26 12:16:50 devstack sudo[112487]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8" returned: 0 in 0.513s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:50 devstack sudo[112504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8 Aug 26 12:16:50 devstack sudo[112495]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:50 devstack sudo[112504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-53a68c73-ca42-43d9-a6ce-5665f6a73afb" returned: 0 in 0.310s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "cinder-quobyte-53a68c73-ca42-43d9-a6ce-5665f6a73afb" released by "delete_volume" :: held 0.853s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Created reservations ['dca792bc-9a93-4885-bbcf-6f0cdd972c49', 'ea7fde20-701c-4f24-b04e-b24e4c0ed202', 'cd245bc5-dc21-48fa-b262-a0f0a9347562', '44a0709f-0fd9-483d-b2ff-ced2fe7e1cc6'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:50 devstack sudo[112504]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15f497dd-b72a-4e60-ac7b-e72faddc7ec8" returned: 0 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:50 devstack sudo[112511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:50 devstack sudo[112511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-quobyte-15f497dd-b72a-4e60-ac7b-e72faddc7ec8" released by "delete_volume" :: held 0.910s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Created reservations ['9bd8eaba-a5b3-4005-8f89-c88460caae76', '47691007-b66f-4268-aac8-7d95e1c70788', '36865a62-b826-4e9a-bc6c-6d26d92b6038', 'b8151147-ac7a-43c9-a1cb-f13ecc2a6240'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:50 devstack sudo[112498]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d 1073741824" returned: 0 in 0.671s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:50 devstack sudo[112513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:50 devstack sudo[112513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:50 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d Aug 26 12:16:50 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:51 devstack sudo[112511]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.500s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Deleted volume successfully. Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d4c3741-a9cb-405c-bc06-1bb4a34b6887 tempest-VolumeAndVolumeTypeFromImageTest-283624022 None] Lock "cinder-53a68c73-ca42-43d9-a6ce-5665f6a73afb-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:51 devstack sudo[112513]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.399s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Deleted volume successfully. Aug 26 12:16:51 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d" returned: 0 in 0.388s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144be58f-8f34-4bb9-a47f-7387cd378811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc01a4c-ef1d-4d5c-9320-11fe2da36520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1e5bfd3e-bb39-4c83-bc28-51c085fd3aa3 tempest-CreateVolumesFromImageTest-892260736 None] Lock "cinder-15f497dd-b72a-4e60-ac7b-e72faddc7ec8-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:51 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Volume volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d (d4bf34e6-371b-4fef-9557-ab9ebfb1c78d): created successfully Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc01a4c-ef1d-4d5c-9320-11fe2da36520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Flow 'volume_create_manager' (1fd24c40-77a4-4409-8fd2-6dd6069e2fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:51 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1ede59c2-e82c-4643-b4a3-08c2d35185f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created volume successfully. Aug 26 12:16:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-quobyte-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:52 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d" acquired by "delete_volume" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:52 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a99e07e-7bb1-48e3-a60c-8dc5d5692d07]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:52 devstack sudo[112520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d Aug 26 12:16:52 devstack sudo[112520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:53 devstack sudo[112520]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d" returned: 0 in 0.527s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:53 devstack sudo[112526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d Aug 26 12:16:53 devstack sudo[112526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:53 devstack sudo[112526]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d" returned: 0 in 0.354s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d" released by "delete_volume" :: held 0.959s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created reservations ['efa1b72a-9b77-4330-b5dd-be438cf411d6', 'ee40bea3-3259-4b65-966b-e37c9e49711a', '9a8d5c9f-0540-4a32-b8f4-a0d27b8ad951', '4e8fe446-5da9-4cd7-b97c-08840128bd0d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:53 devstack sudo[112529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:53 devstack sudo[112529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:54 devstack sudo[112529]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.362s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:54 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:54 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Deleted volume successfully. Aug 26 12:16:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-77e079d6-e317-4fe5-9a3d-ffa9e2bc2772 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-d4bf34e6-371b-4fef-9557-ab9ebfb1c78d-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-a5425f1e-fed4-4f80-89b0-811c6df3a24d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-a5425f1e-fed4-4f80-89b0-811c6df3a24d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-quobyte-a5425f1e-fed4-4f80-89b0-811c6df3a24d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-a5425f1e-fed4-4f80-89b0-811c6df3a24d" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:54 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[400251c2-a71b-4262-b871-78a912042da2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:55 devstack sudo[112532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d Aug 26 12:16:55 devstack sudo[112532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:55 devstack sudo[112532]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d" returned: 0 in 0.511s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:55 devstack sudo[112537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d Aug 26 12:16:55 devstack sudo[112537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:55 devstack sudo[112537]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-a5425f1e-fed4-4f80-89b0-811c6df3a24d" returned: 0 in 0.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-a5425f1e-fed4-4f80-89b0-811c6df3a24d" released by "delete_volume" :: held 0.860s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Created reservations ['28ec4be0-f101-4903-96f2-7818a8601cf6', '2ac6caf5-eb93-4fa6-94fe-5eccafabeb12', 'a5563deb-923a-4459-a10f-2a7e19c448b2', '90506841-b185-4444-ad50-05b565968819'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:55 devstack sudo[112541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:55 devstack sudo[112541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:56 devstack sudo[112541]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.310s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:56 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Deleted volume successfully. Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3d70f830-61d0-42ca-8ce9-7d0ee848edfb tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-a5425f1e-fed4-4f80-89b0-811c6df3a24d-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (c4e09bb7-aa19-4137-84bd-30bf23011a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6bd2b9-7034-4aaa-968e-51514a8af9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-39cb4e65-d34e-4cae-bc35-737d8e93e851-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6bd2b9-7034-4aaa-968e-51514a8af9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213876741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82219c41-ea54-41a4-b9b6-6fcaa1bc472c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:56Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8b4cca-3a75-4b55-accf-f4439a2b64a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8b4cca-3a75-4b55-accf-f4439a2b64a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d45e1be-8b48-4c0a-a987-2a915ffe4a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d45e1be-8b48-4c0a-a987-2a915ffe4a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82219c41-ea54-41a4-b9b6-6fcaa1bc472c', 'volume_name': 'volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60da917a-7e93-46be-a1ac-967a7f6160e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60da917a-7e93-46be-a1ac-967a7f6160e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c04ec5e-9ee0-40bd-aa3d-c7822e756341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:56 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume 82219c41-ea54-41a4-b9b6-6fcaa1bc472c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c', 'volume_size': 1} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213876741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82219c41-ea54-41a4-b9b6-6fcaa1bc472c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:56Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Creating volume 82219c41-ea54-41a4-b9b6-6fcaa1bc472c {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:56 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:56 devstack sudo[112544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c 1073741824 Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-39cb4e65-d34e-4cae-bc35-737d8e93e851-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:56 devstack sudo[112544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-quobyte-39cb4e65-d34e-4cae-bc35-737d8e93e851" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-39cb4e65-d34e-4cae-bc35-737d8e93e851" acquired by "delete_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c40b66e-b640-44aa-a4a0-025225e672b9]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:56 devstack sudo[112546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 Aug 26 12:16:56 devstack sudo[112546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Flow 'volume_create_manager' (041be469-a294-4f36-af11-56f0f376a09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:57 devstack sudo[112544]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8b9300-53e4-42ed-8cb7-dd53ed4e8f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c 1073741824" returned: 0 in 0.616s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8b9300-53e4-42ed-8cb7-dd53ed4e8f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2128185769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09338df4-eab3-4562-a2c9-4ecf6ee4ec55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c87670b92c34619afd998b371b397a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:57Z,use_quota=True,user_id='c444d83ddaf542dea86fa655095a88c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1dc68f-b961-468c-a5af-05c0acc49ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1dc68f-b961-468c-a5af-05c0acc49ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21dc144-d67e-44c1-ba0a-4a9cbc7b4acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21dc144-d67e-44c1-ba0a-4a9cbc7b4acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09338df4-eab3-4562-a2c9-4ecf6ee4ec55', 'volume_name': 'volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0f74bc-6107-4a58-8fd7-f89e77561ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0f74bc-6107-4a58-8fd7-f89e77561ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f9cf82-b14f-4f83-906e-d6e154182241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:57 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Volume 09338df4-eab3-4562-a2c9-4ecf6ee4ec55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55', 'volume_size': 1} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:57 devstack sudo[112555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c Aug 26 12:16:57 devstack sudo[112555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:57 devstack sudo[112546]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851" returned: 0 in 0.600s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:57 devstack sudo[112557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851 Aug 26 12:16:57 devstack sudo[112557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:57 devstack sudo[112555]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c" returned: 0 in 0.314s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2128185769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09338df4-eab3-4562-a2c9-4ecf6ee4ec55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c87670b92c34619afd998b371b397a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:57Z,use_quota=True,user_id='c444d83ddaf542dea86fa655095a88c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Creating volume 09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:57 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:57 devstack sudo[112557]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-39cb4e65-d34e-4cae-bc35-737d8e93e851" returned: 0 in 0.298s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:57 devstack sudo[112561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 1073741824 Aug 26 12:16:57 devstack sudo[112561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c04ec5e-9ee0-40bd-aa3d-c7822e756341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa938c7-e45d-4388-9911-77185d0627d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-39cb4e65-d34e-4cae-bc35-737d8e93e851" released by "delete_volume" :: held 0.976s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:57 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c (82219c41-ea54-41a4-b9b6-6fcaa1bc472c): created successfully Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa938c7-e45d-4388-9911-77185d0627d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (c4e09bb7-aa19-4137-84bd-30bf23011a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:57 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-cfb08c97-dde2-4bdc-a232-7b0d749c363d tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created volume successfully. Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created reservations ['3669b789-3fd5-414e-a33e-3e095d5ce3eb', 'c8f84023-db3e-4ad6-8c43-c5ddf2257d25', '3d905a17-0517-456a-b9c8-822c42d67c15', 'e2e6797b-214c-457d-801e-4ef48c7cffb6'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:57 devstack sudo[112566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:57 devstack sudo[112566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:57 devstack sudo[112561]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 1073741824" returned: 0 in 0.535s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:58 devstack sudo[112566]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.291s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:16:58 devstack sudo[112570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 Aug 26 12:16:58 devstack sudo[112570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Deleted volume successfully. Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-37c10913-9ac4-4620-8de6-7507f27992f2 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-39cb4e65-d34e-4cae-bc35-737d8e93e851-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:58 devstack sudo[112570]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" returned: 0 in 0.299s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f9cf82-b14f-4f83-906e-d6e154182241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3eb020a-ef49-43e0-ba55-4452b3094cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Volume volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 (09338df4-eab3-4562-a2c9-4ecf6ee4ec55): created successfully Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3eb020a-ef49-43e0-ba55-4452b3094cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Flow 'volume_create_manager' (041be469-a294-4f36-af11-56f0f376a09d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-432d66c5-9b35-4427-bb76-d1ad01619796 tempest-VolumeDependencyTests-829481885 None] Created volume successfully. Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-57b94a0a-2811-42a7-b35c-415231ce2234-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-57b94a0a-2811-42a7-b35c-415231ce2234-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-quobyte-57b94a0a-2811-42a7-b35c-415231ce2234" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-57b94a0a-2811-42a7-b35c-415231ce2234" acquired by "delete_volume" :: waited 0.046s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f133094b-6a03-476d-94a8-1ffc49a40ece]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:58 devstack sudo[112573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234 Aug 26 12:16:58 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (d1ad3a54-0278-445c-96f5-022a94397e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b37009-ff79-4741-8c35-30306b016a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b37009-ff79-4741-8c35-30306b016a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278316860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca57cff-8305-4b05-b48a-df8d73acc896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:59Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf353bc-72f1-46a3-ad00-b839f2a30cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf353bc-72f1-46a3-ad00-b839f2a30cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889b1a2d-71d2-4458-8fed-0131df0d495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889b1a2d-71d2-4458-8fed-0131df0d495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca57cff-8305-4b05-b48a-df8d73acc896', 'volume_name': 'volume-3ca57cff-8305-4b05-b48a-df8d73acc896', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dafa9b6-0542-4249-9e11-1b8789f3ab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dafa9b6-0542-4249-9e11-1b8789f3ab01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43c8369-c325-452a-8e81-d4e5a5fb5215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:59 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume 3ca57cff-8305-4b05-b48a-df8d73acc896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca57cff-8305-4b05-b48a-df8d73acc896', 'volume_size': 1} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278316860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca57cff-8305-4b05-b48a-df8d73acc896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:16:59Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Creating volume 3ca57cff-8305-4b05-b48a-df8d73acc896 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:16:59 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:59 devstack sudo[112575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896 1073741824 Aug 26 12:16:59 devstack sudo[112575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:59 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234" returned: 0 in 0.474s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:59 devstack sudo[112581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234 Aug 26 12:16:59 devstack sudo[112581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:16:59 devstack sudo[112581]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (8c0aec5f-c7a6-4e2b-94d9-eabbab028cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873c3036-5ee4-4e0e-954c-2ed032769959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-57b94a0a-2811-42a7-b35c-415231ce2234" returned: 0 in 0.432s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873c3036-5ee4-4e0e-954c-2ed032769959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451431037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be3de3b-1c16-42ba-af8f-1fc2e71b3d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:00Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2f7c5f-e53e-408c-a5f1-d53422735915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2f7c5f-e53e-408c-a5f1-d53422735915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77485f8-e55e-46a4-9ba1-5a8d7cda022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77485f8-e55e-46a4-9ba1-5a8d7cda022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be3de3b-1c16-42ba-af8f-1fc2e71b3d86', 'volume_name': 'volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90b53ea-907d-4fe2-ad70-7d61ae423fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90b53ea-907d-4fe2-ad70-7d61ae423fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acdd16be-10ae-4792-8aa3-5c54eff0ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:16:59 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume 9be3de3b-1c16-42ba-af8f-1fc2e71b3d86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86', 'volume_size': 1} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-57b94a0a-2811-42a7-b35c-415231ce2234" released by "delete_volume" :: held 1.035s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:16:59 devstack sudo[112575]: pam_unix(sudo:session): session closed for user root Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896 1073741824" returned: 0 in 0.705s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Created reservations ['30cd75b8-2627-41b2-8b53-9d9e30552814', '119679f0-6bb9-4395-bb20-d79edd4f6af9', 'f8e9f9ef-a7a9-4c8d-baae-8f17e4cb72c4', '0c463047-2a8a-41c1-b74d-cf93c15aee7d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:16:59 devstack sudo[112588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896 Aug 26 12:16:59 devstack sudo[112588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:16:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:16:59 devstack sudo[112590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:16:59 devstack sudo[112590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:00 devstack sudo[112588]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (31921a28-7cd2-4fa0-b8d8-f97ff173f812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb704acc-673a-43a5-8335-2d7c9af3fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896" returned: 0 in 0.344s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.565s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb704acc-673a-43a5-8335-2d7c9af3fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-426620866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d94c7cc-58f3-4d12-97f9-6d3107e2d757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:00Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca150214-5cb8-4929-877b-127d0ab242b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca150214-5cb8-4929-877b-127d0ab242b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2560a627-a177-49dd-80a2-6be0ea484c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2560a627-a177-49dd-80a2-6be0ea484c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d94c7cc-58f3-4d12-97f9-6d3107e2d757', 'volume_name': 'volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7e19cf-b3f0-4d1d-a87e-f2a379e895d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7e19cf-b3f0-4d1d-a87e-f2a379e895d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3d8bca-9bfa-4ec2-af38-04edb7531561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume 9d94c7cc-58f3-4d12-97f9-6d3107e2d757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757', 'volume_size': 1} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43c8369-c325-452a-8e81-d4e5a5fb5215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca57cff-8305-4b05-b48a-df8d73acc896', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e7a9eb-3cd9-43ce-9c1b-10a22109b2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Creating offline snapshot 3104bb89-b404-45d4-9e27-68e393832207 of volume 09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:17:00 devstack sudo[112590]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.338s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:00 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume volume-3ca57cff-8305-4b05-b48a-df8d73acc896 (3ca57cff-8305-4b05-b48a-df8d73acc896): created successfully Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e7a9eb-3cd9-43ce-9c1b-10a22109b2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (d1ad3a54-0278-445c-96f5-022a94397e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Deleted volume successfully. Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[db92aea9-8923-478e-a533-7055c0b9aaa9]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:00 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-72387939-16d9-4229-b5f2-ca6844d5364f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created volume successfully. Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4a1d2f06-cfb3-4236-8d1e-50614768650b tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-57b94a0a-2811-42a7-b35c-415231ce2234-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:00 devstack sudo[112594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 Aug 26 12:17:00 devstack sudo[112594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (b6049861-6965-4017-8a41-a82c1ca1ab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6330786d-9cc4-422e-8869-f94bf78b2eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6330786d-9cc4-422e-8869-f94bf78b2eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964942602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83b9bce-48ff-42d6-9535-0c980302e4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:00Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f4efa4-350c-4bf1-a413-3288e9fdef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f4efa4-350c-4bf1-a413-3288e9fdef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd43070-ef22-4196-b17a-6bb961432546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd43070-ef22-4196-b17a-6bb961432546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83b9bce-48ff-42d6-9535-0c980302e4b6', 'volume_name': 'volume-f83b9bce-48ff-42d6-9535-0c980302e4b6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c0cb50-c2d0-43e2-bb04-15af0a24d315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c0cb50-c2d0-43e2-bb04-15af0a24d315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84741ccf-4fca-49cb-bea5-5d44135fcd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:00 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume f83b9bce-48ff-42d6-9535-0c980302e4b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83b9bce-48ff-42d6-9535-0c980302e4b6', 'volume_size': 1} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:00 devstack sudo[112594]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" returned: 0 in 0.527s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:00 devstack sudo[112600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 1G Aug 26 12:17:00 devstack sudo[112600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-5ae746a2-876b-41ba-8b6f-8ab5df5843f5-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:00 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-5ae746a2-876b-41ba-8b6f-8ab5df5843f5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-quobyte-5ae746a2-876b-41ba-8b6f-8ab5df5843f5" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-5ae746a2-876b-41ba-8b6f-8ab5df5843f5" acquired by "delete_volume" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (ccd20851-fcc2-40a6-a112-576399ac0754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38185139-57d0-462b-88c6-8231ddf083a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[15efd127-f055-484a-bfca-27aa02184daf]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38185139-57d0-462b-88c6-8231ddf083a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364950319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff3faae-75de-40b9-aa2a-fa0c91aa708c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:01Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c7b692-b9e9-4e79-8934-dbd7ee899647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c7b692-b9e9-4e79-8934-dbd7ee899647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badd713c-79c8-4f85-b841-f7e206f19ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badd713c-79c8-4f85-b841-f7e206f19ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff3faae-75de-40b9-aa2a-fa0c91aa708c', 'volume_name': 'volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15aecd1-ad1d-4242-86d8-65f4e9d11f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15aecd1-ad1d-4242-86d8-65f4e9d11f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388a29fc-2b0d-411c-823e-7ccd7434f6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:01 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume 7ff3faae-75de-40b9-aa2a-fa0c91aa708c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c', 'volume_size': 1} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:01 devstack sudo[112605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 Aug 26 12:17:01 devstack sudo[112605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:01 devstack sudo[112600]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 1G" returned: 0 in 0.555s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:01 devstack sudo[112611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 Aug 26 12:17:01 devstack sudo[112611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:01 devstack sudo[112605]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5" returned: 0 in 0.441s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:01 devstack sudo[112616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5 Aug 26 12:17:01 devstack sudo[112616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:01 devstack sudo[112611]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207" returned: 0 in 0.372s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:01 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 is being set with open permissions: ugo+rw Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:01 devstack sudo[112621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 Aug 26 12:17:01 devstack sudo[112621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:01 devstack sudo[112616]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5ae746a2-876b-41ba-8b6f-8ab5df5843f5" returned: 0 in 0.337s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-5ae746a2-876b-41ba-8b6f-8ab5df5843f5" released by "delete_volume" :: held 0.866s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:01 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Created reservations ['8c047176-5057-4ec3-b81d-2eafae9fd748', '375620b3-fab2-4eb8-b7e7-a3c56fc96f79', '873d496b-b8b0-49a7-a4a4-f76f284787ec', '195c8dcc-8ef8-4d9c-8098-067da75591c3'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:02 devstack sudo[112621]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207" returned: 0 in 0.322s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:02 devstack sudo[112625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:02 devstack sudo[112625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-05ec008c-42e4-4300-9a66-00cbb5f7ad1b-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-05ec008c-42e4-4300-9a66-00cbb5f7ad1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-quobyte-427f2784-4aa2-412e-a56b-f7006ccb0869" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:02 devstack sudo[112627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.info Aug 26 12:17:02 devstack sudo[112627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-427f2784-4aa2-412e-a56b-f7006ccb0869" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-quobyte-05ec008c-42e4-4300-9a66-00cbb5f7ad1b" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-05ec008c-42e4-4300-9a66-00cbb5f7ad1b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Deleting offline snapshot 05ec008c-42e4-4300-9a66-00cbb5f7ad1b of volume 427f2784-4aa2-412e-a56b-f7006ccb0869 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] snapshot_file for this snap is: volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f6e10-fa6d-4313-a6b7-5663ba596e07]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:02 devstack sudo[112625]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.293s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Deleted volume successfully. Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-2231d7ec-10e6-4f96-9905-6e2b441590de tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-5ae746a2-876b-41ba-8b6f-8ab5df5843f5-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:02 devstack sudo[112629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b Aug 26 12:17:02 devstack sudo[112629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:02 devstack sudo[112627]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.info" returned: 0 in 0.358s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:02 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.info is being set with open permissions: ugo+rw Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:02 devstack sudo[112633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.info Aug 26 12:17:02 devstack sudo[112633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:02 devstack sudo[112629]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b" returned: 0 in 0.409s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-427f2784-4aa2-412e-a56b-f7006ccb0869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc6b267-40d7-436a-869c-8d72d2ab945d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:02 devstack sudo[112633]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.info" returned: 0 in 0.296s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:02 devstack sudo[112639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 Aug 26 12:17:02 devstack sudo[112639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.680s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.109s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451431037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be3de3b-1c16-42ba-af8f-1fc2e71b3d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:00Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Creating volume 9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:02 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:02 devstack sudo[112642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 1073741824 Aug 26 12:17:02 devstack sudo[112642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-83378f22-fb58-4403-a0ee-b4c65e3ae640 tempest-VolumeDependencyTests-829481885 None] Create snapshot completed successfully Aug 26 12:17:03 devstack sudo[112639]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869" returned: 0 in 0.477s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:03 devstack sudo[112648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b Aug 26 12:17:03 devstack sudo[112648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:03 devstack sudo[112642]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 1073741824" returned: 0 in 0.613s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:03 devstack sudo[112656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 Aug 26 12:17:03 devstack sudo[112656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:03 devstack sudo[112648]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b" returned: 0 in 0.469s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:03 devstack sudo[112658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b Aug 26 12:17:03 devstack sudo[112658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:03 devstack sudo[112656]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86" returned: 0 in 0.336s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.634s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-426620866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d94c7cc-58f3-4d12-97f9-6d3107e2d757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:00Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Creating volume 9d94c7cc-58f3-4d12-97f9-6d3107e2d757 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:03 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:03 devstack sudo[112661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 1073741824 Aug 26 12:17:03 devstack sudo[112661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acdd16be-10ae-4792-8aa3-5c54eff0ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10d81be-babd-4205-aa89-2015a5301030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:03 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 (9be3de3b-1c16-42ba-af8f-1fc2e71b3d86): created successfully Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10d81be-babd-4205-aa89-2015a5301030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:03 devstack sudo[112658]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (8c0aec5f-c7a6-4e2b-94d9-eabbab028cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869.05ec008c-42e4-4300-9a66-00cbb5f7ad1b" returned: 0 in 0.307s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:03 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-67b02c89-ca85-4d23-8a00-607384a22899 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created volume successfully. Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-05ec008c-42e4-4300-9a66-00cbb5f7ad1b" released by "_delete_snapshot" :: held 1.814s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-427f2784-4aa2-412e-a56b-f7006ccb0869" released by "delete_snapshot" :: held 1.845s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created reservations ['d9fecfbd-3a45-4956-bb2f-6eefad2ec0b9', '9809c1c3-8057-4d87-9aa8-76d9accc0fe5', '52bee62c-4b27-4b93-9a30-855aa528856e', 'd7ae84bd-492f-48d7-b4d0-d500a2512aad'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:04 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Delete snapshot completed successfully. Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a2436bf8-391e-4818-a1aa-221921b4aeb4 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-05ec008c-42e4-4300-9a66-00cbb5f7ad1b-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-427f2784-4aa2-412e-a56b-f7006ccb0869-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-427f2784-4aa2-412e-a56b-f7006ccb0869-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "cinder-quobyte-427f2784-4aa2-412e-a56b-f7006ccb0869" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-427f2784-4aa2-412e-a56b-f7006ccb0869" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1f4efc-76bd-49dc-9dd1-1620ee72cf41]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:04 devstack sudo[112661]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Flow 'volume_create_manager' (63706d7d-7213-4d21-80c1-0663dcd3e337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f6f3d8-4ce1-4b9b-9ca1-0ef32fdf4833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 1073741824" returned: 0 in 0.710s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f6f3d8-4ce1-4b9b-9ca1-0ef32fdf4833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-673075148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c416694-9834-449b-91dc-3d91596cadca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c87670b92c34619afd998b371b397a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3104bb89-b404-45d4-9e27-68e393832207,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:04Z,use_quota=True,user_id='c444d83ddaf542dea86fa655095a88c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837e2c3d-ef30-49cd-b31c-387db0d2cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837e2c3d-ef30-49cd-b31c-387db0d2cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4070742-dca1-41db-b052-9e8f0acd70c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4070742-dca1-41db-b052-9e8f0acd70c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c416694-9834-449b-91dc-3d91596cadca', 'volume_name': 'volume-9c416694-9834-449b-91dc-3d91596cadca', 'volume_size': 1, 'snapshot_id': '3104bb89-b404-45d4-9e27-68e393832207'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:04 devstack sudo[112670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 Aug 26 12:17:04 devstack sudo[112670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5dffdff-9837-4c3c-b82a-2a6b45172345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5dffdff-9837-4c3c-b82a-2a6b45172345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9374bfa2-2c09-491b-a904-88dd1f537f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:04 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Volume 9c416694-9834-449b-91dc-3d91596cadca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c416694-9834-449b-91dc-3d91596cadca', 'volume_size': 1, 'snapshot_id': '3104bb89-b404-45d4-9e27-68e393832207'} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:04 devstack sudo[112672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 Aug 26 12:17:04 devstack sudo[112672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:04 devstack sudo[112670]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869" returned: 0 in 0.409s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:04 devstack sudo[112678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869 Aug 26 12:17:04 devstack sudo[112678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:04 devstack sudo[112672]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757" returned: 0 in 0.287s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.368s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964942602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83b9bce-48ff-42d6-9535-0c980302e4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:00Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Creating volume f83b9bce-48ff-42d6-9535-0c980302e4b6 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:04 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:04 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3d8bca-9bfa-4ec2-af38-04edb7531561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:05 devstack sudo[112680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 1073741824 Aug 26 12:17:05 devstack sudo[112680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd38f525-c15a-4ba1-b0a1-f50a2a215a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:05 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 (9d94c7cc-58f3-4d12-97f9-6d3107e2d757): created successfully Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd38f525-c15a-4ba1-b0a1-f50a2a215a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (31921a28-7cd2-4fa0-b8d8-f97ff173f812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a409746e-2cdf-4bab-b566-f3d11ee18ad4 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created volume successfully. Aug 26 12:17:05 devstack sudo[112678]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-427f2784-4aa2-412e-a56b-f7006ccb0869" returned: 0 in 0.290s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-quobyte-427f2784-4aa2-412e-a56b-f7006ccb0869" released by "delete_volume" :: held 0.780s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Created reservations ['bd18da75-84c0-4d28-9e74-24943d492d84', 'a46716dd-37ce-4c4e-982f-ef1da5131962', '9414efd5-05a9-4905-98f9-dd17c38fb851', '68846001-886b-4614-910d-62cf2ddbd631'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:05 devstack sudo[112686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:05 devstack sudo[112686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:05 devstack sudo[112680]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 1073741824" returned: 0 in 0.581s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:05 devstack sudo[112689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 Aug 26 12:17:05 devstack sudo[112689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:05 devstack sudo[112686]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.322s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Deleted volume successfully. Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1315f0b6-a772-4eeb-bd3e-f5cc01bf5b30 tempest-CreateVolumesFromSnapshotTest-840300471 None] Lock "cinder-427f2784-4aa2-412e-a56b-f7006ccb0869-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:05 devstack sudo[112689]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6" returned: 0 in 0.305s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.752s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364950319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff3faae-75de-40b9-aa2a-fa0c91aa708c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67452d6f1cd648da9ac6a31a07b7f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:01Z,use_quota=True,user_id='d7670a036332463aac68f183d3fd4379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Creating volume 7ff3faae-75de-40b9-aa2a-fa0c91aa708c {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:05 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84741ccf-4fca-49cb-bea5-5d44135fcd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83b9bce-48ff-42d6-9535-0c980302e4b6', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dfc15f-42b2-4588-b9b7-54cedaad24fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:05 devstack sudo[112693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c 1073741824 Aug 26 12:17:05 devstack sudo[112693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:05 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 (f83b9bce-48ff-42d6-9535-0c980302e4b6): created successfully Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dfc15f-42b2-4588-b9b7-54cedaad24fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:05 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (b6049861-6965-4017-8a41-a82c1ca1ab85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:06 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b317649c-f303-42fe-8511-90e827227cc9 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created volume successfully. Aug 26 12:17:06 devstack sudo[112693]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c 1073741824" returned: 0 in 0.554s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:06 devstack sudo[112699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c Aug 26 12:17:06 devstack sudo[112699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Flow 'volume_create_manager' (47ce1aee-8dc8-4aed-90d5-c3c5b18ddbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0951e77d-9d63-4f1a-a493-31cc0325f523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:06 devstack sudo[112699]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0951e77d-9d63-4f1a-a493-31cc0325f523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884065340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce44daa0-cdb8-4f51-8e00-c02f948cd173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22f0736ba04417ca9b6e1d9d0acb0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:07Z,use_quota=True,user_id='1c2bf4a6a45a4c4fb0f33579b91c480b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2780f5dc-1b19-4e6a-b896-5d51cea91514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2780f5dc-1b19-4e6a-b896-5d51cea91514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07608a30-1bea-448b-a2b4-7bf02a6a8b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07608a30-1bea-448b-a2b4-7bf02a6a8b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce44daa0-cdb8-4f51-8e00-c02f948cd173', 'volume_name': 'volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824a11df-9c31-452d-bdc8-d2c079e89eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824a11df-9c31-452d-bdc8-d2c079e89eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69a9d6b-a268-455b-af28-51327066c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:06 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Volume ce44daa0-cdb8-4f51-8e00-c02f948cd173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173', 'volume_size': 1} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c" returned: 0 in 0.354s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.244s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "cinder-quobyte-3104bb89-b404-45d4-9e27-68e393832207-9c416694-9834-449b-91dc-3d91596cadca" by "_create_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388a29fc-2b0d-411c-823e-7ccd7434f6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc7d6ba-4f11-4d86-ab1d-5548d0df8bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-3104bb89-b404-45d4-9e27-68e393832207-9c416694-9834-449b-91dc-3d91596cadca" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Creating volume 9c416694-9834-449b-91dc-3d91596cadca from snapshot 3104bb89-b404-45d4-9e27-68e393832207 {{(pid=94387) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "cinder-quobyte-9c416694-9834-449b-91dc-3d91596cadca" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:06 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Volume volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c (7ff3faae-75de-40b9-aa2a-fa0c91aa708c): created successfully Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc7d6ba-4f11-4d86-ab1d-5548d0df8bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Flow 'volume_create_manager' (ccd20851-fcc2-40a6-a112-576399ac0754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:06 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-687dd3ad-cc59-47b1-9829-8273b438e111 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created volume successfully. Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-9c416694-9834-449b-91dc-3d91596cadca" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] snapshot: 3104bb89-b404-45d4-9e27-68e393832207, volume: 9c416694-9834-449b-91dc-3d91596cadca, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0a3b66-823b-48b0-a0a9-905ccaef4b93]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:07 devstack sudo[112702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 Aug 26 12:17:07 devstack sudo[112702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:07 devstack sudo[112702]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207" returned: 0 in 0.377s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c832d8d-d76c-4e71-a768-f0b474f3402d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:07 devstack sudo[112707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 Aug 26 12:17:07 devstack sudo[112707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:07 devstack sudo[112707]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" returned: 0 in 0.398s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:07 devstack sudo[112712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca Aug 26 12:17:07 devstack sudo[112712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-7ff3faae-75de-40b9-aa2a-fa0c91aa708c-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-7ff3faae-75de-40b9-aa2a-fa0c91aa708c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-quobyte-7ff3faae-75de-40b9-aa2a-fa0c91aa708c" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-7ff3faae-75de-40b9-aa2a-fa0c91aa708c" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c96647e-3e24-4e0f-9938-f5e92e36dd95]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:08 devstack sudo[112714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c Aug 26 12:17:08 devstack sudo[112714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:08 devstack sudo[112714]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c" returned: 0 in 0.545s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:08 devstack sudo[112730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c Aug 26 12:17:08 devstack sudo[112730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:09 devstack sudo[112730]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-7ff3faae-75de-40b9-aa2a-fa0c91aa708c" returned: 0 in 0.835s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-7ff3faae-75de-40b9-aa2a-fa0c91aa708c" released by "delete_volume" :: held 1.458s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created reservations ['082a73eb-ff7f-4626-be95-606f1627371f', 'c996a622-bfc6-4af9-85dd-54c9acdd80c6', '025117f8-2396-48fa-a3e8-36185d9c053d', '2fde662a-8216-4769-aec7-876413b20111'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Flow 'volume_create_manager' (02b0250c-718c-4044-8bbe-324c7afe7378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2df3a8-5e96-457a-bc4d-62dc280a7db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2df3a8-5e96-457a-bc4d-62dc280a7db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31e4884-e25a-41ca-b077-e9cb7a27fcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c27d4666184a459b79707c98873bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:10Z,use_quota=True,user_id='dd3513c71d6b4bac852cf4c976639258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d27db32-fd51-43f4-9a98-592f4e54277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d27db32-fd51-43f4-9a98-592f4e54277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9754a58c-2408-4316-b5c8-7726d0b76d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9754a58c-2408-4316-b5c8-7726d0b76d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31e4884-e25a-41ca-b077-e9cb7a27fcb1', 'volume_name': 'volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2521e01e-02c1-4811-8829-350b5660b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2521e01e-02c1-4811-8829-350b5660b185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6ba66a-1e69-45fe-9a23-4fc4d6eb0474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:09 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Volume e31e4884-e25a-41ca-b077-e9cb7a27fcb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1', 'volume_size': 1} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:09 devstack sudo[112733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:09 devstack sudo[112733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:10 devstack sudo[112733]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Deleted volume successfully. Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-5d557df7-92a5-44be-aadf-2de2bf8f222f tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-7ff3faae-75de-40b9-aa2a-fa0c91aa708c-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-f83b9bce-48ff-42d6-9535-0c980302e4b6-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-f83b9bce-48ff-42d6-9535-0c980302e4b6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-quobyte-f83b9bce-48ff-42d6-9535-0c980302e4b6" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-f83b9bce-48ff-42d6-9535-0c980302e4b6" acquired by "delete_volume" :: waited 0.032s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ce8368-6800-4edc-a16b-aed70a2a5148]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:10 devstack sudo[112736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:10 devstack sudo[112736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:10 devstack sudo[112737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 Aug 26 12:17:10 devstack sudo[112737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:11 devstack sudo[112736]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.651s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:11 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:11 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:17:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:17:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:17:11 devstack sudo[112737]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6" returned: 0 in 0.880s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:11 devstack sudo[112744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6 Aug 26 12:17:11 devstack sudo[112744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:12 devstack sudo[112744]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-f83b9bce-48ff-42d6-9535-0c980302e4b6" returned: 0 in 0.597s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-f83b9bce-48ff-42d6-9535-0c980302e4b6" released by "delete_volume" :: held 1.596s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created reservations ['df35215f-7eed-43d2-a9cf-6c430cc7ebf9', '870f4a2f-32f2-4c3d-bd35-48ba2975b100', '29747248-0424-4fda-b407-a8bd2b8846b8', 'bed98978-b7f5-4c88-b6fd-c02c22576939'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:12 devstack sudo[112748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:12 devstack sudo[112748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-9d94c7cc-58f3-4d12-97f9-6d3107e2d757-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-9d94c7cc-58f3-4d12-97f9-6d3107e2d757-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-quobyte-9d94c7cc-58f3-4d12-97f9-6d3107e2d757" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:12 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-9d94c7cc-58f3-4d12-97f9-6d3107e2d757" acquired by "delete_volume" :: waited 0.041s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d719bc0f-57c7-42df-8359-43340d19116d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca" returned: 0 in 5.319s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:17:13 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Converted 1024.00 MB image at 192.43 MB/s Aug 26 12:17:13 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca is being set with open permissions: ugo+rw Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:13 devstack sudo[112748]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.735s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:13 devstack sudo[112753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca Aug 26 12:17:13 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Deleted volume successfully. Aug 26 12:17:13 devstack sudo[112751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 Aug 26 12:17:13 devstack sudo[112751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c4167969-544c-4436-877f-d731d3f2a437 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-f83b9bce-48ff-42d6-9535-0c980302e4b6-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:13 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca" returned: 0 in 0.280s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-9c416694-9834-449b-91dc-3d91596cadca" released by "_copy_volume_from_snapshot" :: held 6.467s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:13 devstack sudo[112751]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757" returned: 0 in 0.461s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-3104bb89-b404-45d4-9e27-68e393832207-9c416694-9834-449b-91dc-3d91596cadca" released by "_create_volume_from_snapshot" :: held 6.578s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.612s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.622s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884065340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce44daa0-cdb8-4f51-8e00-c02f948cd173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22f0736ba04417ca9b6e1d9d0acb0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:07Z,use_quota=True,user_id='1c2bf4a6a45a4c4fb0f33579b91c480b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Creating volume ce44daa0-cdb8-4f51-8e00-c02f948cd173 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:13 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:13 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757 Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:13 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:13 devstack sudo[112762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 1073741824 Aug 26 12:17:13 devstack sudo[112762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9374bfa2-2c09-491b-a904-88dd1f537f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c416694-9834-449b-91dc-3d91596cadca', 'volume_size': 1, 'snapshot_id': '3104bb89-b404-45d4-9e27-68e393832207'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d757249-d64d-4c87-a8dc-fb7358b3c2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:13 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Volume volume-9c416694-9834-449b-91dc-3d91596cadca (9c416694-9834-449b-91dc-3d91596cadca): created successfully Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d757249-d64d-4c87-a8dc-fb7358b3c2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Flow 'volume_create_manager' (63706d7d-7213-4d21-80c1-0663dcd3e337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-27450b06-bbf1-4e87-89c0-1777077e1936 tempest-VolumeDependencyTests-829481885 None] Created volume successfully. Aug 26 12:17:13 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9d94c7cc-58f3-4d12-97f9-6d3107e2d757" returned: 0 in 0.281s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-9d94c7cc-58f3-4d12-97f9-6d3107e2d757" released by "delete_volume" :: held 0.819s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created reservations ['5039ead7-803f-41c1-94d3-0dfc7dfb21be', 'b87e4f81-1498-4290-bccb-b005ae39b590', '8be22ee2-97ba-4e48-bfd8-c9f346e05f0d', '39d95f58-599a-4852-a3c1-a83273a85d18'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:13 devstack sudo[112768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:13 devstack sudo[112768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:14 devstack sudo[112762]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 1073741824" returned: 0 in 0.521s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:14 devstack sudo[112771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 Aug 26 12:17:14 devstack sudo[112771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-quobyte-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[93524913-4341-481a-8569-9cd8569b858a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:14 devstack sudo[112768]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.282s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Deleted volume successfully. Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1c1a6ece-a9ee-4a8b-8c1e-e9312ae733ff tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-9d94c7cc-58f3-4d12-97f9-6d3107e2d757-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:14 devstack sudo[112774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 Aug 26 12:17:14 devstack sudo[112774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:14 devstack sudo[112771]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Acquiring lock "cinder-3104bb89-b404-45d4-9e27-68e393832207-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173" returned: 0 in 0.294s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.553s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31e4884-e25a-41ca-b077-e9cb7a27fcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c27d4666184a459b79707c98873bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:10Z,use_quota=True,user_id='dd3513c71d6b4bac852cf4c976639258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Creating volume e31e4884-e25a-41ca-b077-e9cb7a27fcb1 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:14 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Lock "cinder-3104bb89-b404-45d4-9e27-68e393832207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Acquiring lock "cinder-quobyte-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69a9d6b-a268-455b-af28-51327066c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:14 devstack sudo[112777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 1073741824 Aug 26 12:17:14 devstack sudo[112777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01275b5-8f42-48bc-9ef0-3eac00a43f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Acquiring lock "cinder-quobyte-3104bb89-b404-45d4-9e27-68e393832207" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:14 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Volume volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 (ce44daa0-cdb8-4f51-8e00-c02f948cd173): created successfully Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01275b5-8f42-48bc-9ef0-3eac00a43f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Flow 'volume_create_manager' (47ce1aee-8dc8-4aed-90d5-c3c5b18ddbe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-50f2be72-67ab-41c3-97cd-5450ea90eb59 tempest-ProjectReaderTests-481744995 None] Created volume successfully. Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-3104bb89-b404-45d4-9e27-68e393832207" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Deleting offline snapshot 3104bb89-b404-45d4-9e27-68e393832207 of volume 09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] snapshot_file for this snap is: volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d2ad44-fcd0-4057-86fc-5d9e55fc237c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:14 devstack sudo[112774]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86" returned: 0 in 0.408s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:14 devstack sudo[112784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86 Aug 26 12:17:14 devstack sudo[112784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:14 devstack sudo[112783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 Aug 26 12:17:14 devstack sudo[112783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Acquiring lock "cinder-ce44daa0-cdb8-4f51-8e00-c02f948cd173-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Lock "cinder-ce44daa0-cdb8-4f51-8e00-c02f948cd173-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:14 devstack sudo[112784]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86" returned: 0 in 0.363s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Acquiring lock "cinder-quobyte-ce44daa0-cdb8-4f51-8e00-c02f948cd173" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86" released by "delete_volume" :: held 0.817s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:14 devstack sudo[112777]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Lock "cinder-quobyte-ce44daa0-cdb8-4f51-8e00-c02f948cd173" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 1073741824" returned: 0 in 0.591s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5914a6-255c-48b2-a0c9-200c89035736]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:15 devstack sudo[112783]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207" returned: 0 in 0.477s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c5f2d0-ee64-44fb-9e42-55fe241ceb10]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created reservations ['5250c466-9c8a-4903-8270-15236585e255', 'c1b8da76-d983-4d46-a96e-c6db238a54b7', 'b43159aa-d0ad-408b-bedc-87ec8c3fa49e', 'ca271537-bcca-4d98-bfc9-4c75670d0f4f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:15 devstack sudo[112797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 Aug 26 12:17:15 devstack sudo[112797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:15 devstack sudo[112795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 Aug 26 12:17:15 devstack sudo[112795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:15 devstack sudo[112796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 Aug 26 12:17:15 devstack sudo[112796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:15 devstack sudo[112800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:15 devstack sudo[112800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-3ca57cff-8305-4b05-b48a-df8d73acc896-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-3ca57cff-8305-4b05-b48a-df8d73acc896-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-quobyte-3ca57cff-8305-4b05-b48a-df8d73acc896" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-3ca57cff-8305-4b05-b48a-df8d73acc896" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabca5e8-f124-4b1f-9cbe-0838e26b66f1]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:15 devstack sudo[112797]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1" returned: 0 in 0.414s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6ba66a-1e69-45fe-9a23-4fc4d6eb0474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c22a5a9-c95e-4d54-b72c-13f29bda86be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:15 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Volume volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 (e31e4884-e25a-41ca-b077-e9cb7a27fcb1): created successfully Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c22a5a9-c95e-4d54-b72c-13f29bda86be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Flow 'volume_create_manager' (02b0250c-718c-4044-8bbe-324c7afe7378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-358833ea-eb15-4516-add3-6b0691be66fc tempest-CinderUnicodeTest-289737060 None] Created volume successfully. Aug 26 12:17:15 devstack sudo[112795]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173" returned: 0 in 0.578s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:15 devstack sudo[112811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173 Aug 26 12:17:15 devstack sudo[112811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:15 devstack sudo[112808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896 Aug 26 12:17:15 devstack sudo[112808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:15 devstack sudo[112800]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.453s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Deleted volume successfully. Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-efebb878-c037-4aaf-a33f-bbf6e28c02ec tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-9be3de3b-1c16-42ba-af8f-1fc2e71b3d86-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:15 devstack sudo[112796]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" returned: 0 in 0.701s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:15 devstack sudo[112816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 Aug 26 12:17:15 devstack sudo[112816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:15 devstack sudo[112811]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ce44daa0-cdb8-4f51-8e00-c02f948cd173" returned: 0 in 0.319s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Lock "cinder-quobyte-ce44daa0-cdb8-4f51-8e00-c02f948cd173" released by "delete_volume" :: held 0.974s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:15 devstack sudo[112808]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896" returned: 0 in 0.491s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:16 devstack sudo[112823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896 Aug 26 12:17:16 devstack sudo[112823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Created reservations ['7dc2bda3-a7b3-466b-9f90-8e3db9399daf', 'b6fb7638-9ab6-40f5-9461-80b9cbf980c7', 'ed38db40-bb2e-4d6d-baa8-fb83af545a2a', 'e89aa391-8e73-4e36-a4da-4ad7e8a1cf64'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:16 devstack sudo[112816]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207" returned: 0 in 0.395s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:16 devstack sudo[112830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:16 devstack sudo[112830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:16 devstack sudo[112832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207 Aug 26 12:17:16 devstack sudo[112832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:16 devstack sudo[112823]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3ca57cff-8305-4b05-b48a-df8d73acc896" returned: 0 in 0.323s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-3ca57cff-8305-4b05-b48a-df8d73acc896" released by "delete_volume" :: held 0.879s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created reservations ['939e926a-4ef9-494e-9d7d-0659c4e87080', '38513dfd-8387-4b31-b182-c24a84e7864c', '864c05f5-8f64-4780-9935-2e83e4b8ea5d', 'cd18ec5a-80fd-4b75-a9bb-b5e1503cb8c9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:16 devstack sudo[112830]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:16 devstack sudo[112832]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55.3104bb89-b404-45d4-9e27-68e393832207" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.392s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Deleted volume successfully. Aug 26 12:17:16 devstack sudo[112837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:16 devstack sudo[112837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-82219c41-ea54-41a4-b9b6-6fcaa1bc472c-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-3104bb89-b404-45d4-9e27-68e393832207" released by "_delete_snapshot" :: held 2.088s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-18a3e95e-9a89-434d-95c3-0c373dfd46c0 tempest-ProjectReaderTests-481744995 None] Lock "cinder-ce44daa0-cdb8-4f51-8e00-c02f948cd173-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" released by "delete_snapshot" :: held 2.169s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-82219c41-ea54-41a4-b9b6-6fcaa1bc472c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Flow 'volume_create_manager' (6b691e8c-108b-4aea-87ea-fd3116ba07f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742759af-9e86-4c53-916e-b1f9400f1a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742759af-9e86-4c53-916e-b1f9400f1a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-701308440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1226d09e-b8bd-48e0-93ca-c37cf9fc3201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c27d4666184a459b79707c98873bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:17Z,use_quota=True,user_id='dd3513c71d6b4bac852cf4c976639258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4ac0ed-dc04-43a2-a6be-1a1ec8279c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4ac0ed-dc04-43a2-a6be-1a1ec8279c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1afde9-6116-4792-acb1-293783e8fc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1afde9-6116-4792-acb1-293783e8fc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1226d09e-b8bd-48e0-93ca-c37cf9fc3201', 'volume_name': 'volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4889ba-219b-4b30-813e-cc17a420fb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4889ba-219b-4b30-813e-cc17a420fb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508db276-e930-47a7-909c-c4b7ae79c147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:16 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Volume 1226d09e-b8bd-48e0-93ca-c37cf9fc3201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201', 'volume_size': 1} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-701308440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1226d09e-b8bd-48e0-93ca-c37cf9fc3201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c27d4666184a459b79707c98873bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:17Z,use_quota=True,user_id='dd3513c71d6b4bac852cf4c976639258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Creating volume 1226d09e-b8bd-48e0-93ca-c37cf9fc3201 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:16 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:16 devstack sudo[112837]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "cinder-quobyte-82219c41-ea54-41a4-b9b6-6fcaa1bc472c" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:16 devstack sudo[112840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 1073741824 Aug 26 12:17:16 devstack sudo[112840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.321s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Deleted volume successfully. Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-82219c41-ea54-41a4-b9b6-6fcaa1bc472c" acquired by "delete_volume" :: waited 0.028s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Created reservations ['b9133e51-53e4-4df2-b1e6-e4b2b6da1eaf', 'c8fba962-19b4-40e5-bbf2-3833d06e024b', '6f09f4b5-a19f-44d7-915b-89a5a45b5c7d', '98ec59ec-967e-4c3f-8a71-bd01afb84c4d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-7ca086ee-5d0c-4fb2-98b5-e5bd1a6b30da tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-3ca57cff-8305-4b05-b48a-df8d73acc896-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c593985-2b14-43b7-9b9b-8e23788ee6bd]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Delete snapshot completed successfully. Aug 26 12:17:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-503fb6e2-b609-426d-bb79-eb1b34c84bea tempest-VolumeDependencyTests-829481885 None] Lock "cinder-3104bb89-b404-45d4-9e27-68e393832207-delete_snapshot" released by "delete_snapshot" :: held 2.532s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:17 devstack sudo[112842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c Aug 26 12:17:17 devstack sudo[112842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:17 devstack sudo[112840]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 1073741824" returned: 0 in 0.464s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:17 devstack sudo[112842]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c" returned: 0 in 0.440s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:17 devstack sudo[112851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 Aug 26 12:17:17 devstack sudo[112851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:17 devstack sudo[112853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c Aug 26 12:17:17 devstack sudo[112853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:17 devstack sudo[112851]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:17 devstack sudo[112853]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" returned: 0 in 0.340s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-82219c41-ea54-41a4-b9b6-6fcaa1bc472c" returned: 0 in 0.319s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Acquiring lock "cinder-09338df4-eab3-4562-a2c9-4ecf6ee4ec55-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508db276-e930-47a7-909c-c4b7ae79c147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d13d562-37e0-4289-bce5-7e335f1e295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-quobyte-82219c41-ea54-41a4-b9b6-6fcaa1bc472c" released by "delete_volume" :: held 0.860s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Flow 'volume_create_manager' (dd1389d6-d934-4388-b25c-14f28334a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef10b4c-d0a6-4f7f-996b-f8644139f43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Lock "cinder-09338df4-eab3-4562-a2c9-4ecf6ee4ec55-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Volume volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 (1226d09e-b8bd-48e0-93ca-c37cf9fc3201): created successfully Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d13d562-37e0-4289-bce5-7e335f1e295c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Flow 'volume_create_manager' (6b691e8c-108b-4aea-87ea-fd3116ba07f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef10b4c-d0a6-4f7f-996b-f8644139f43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689028118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be928ca5-1018-4e0b-ae6b-e6df745b50ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22f0736ba04417ca9b6e1d9d0acb0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:18Z,use_quota=True,user_id='1c2bf4a6a45a4c4fb0f33579b91c480b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bee7335-cbfc-4823-a6ab-723866fd9656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bee7335-cbfc-4823-a6ab-723866fd9656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d5da81-5e23-40c0-a775-e9e3c10cf3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d5da81-5e23-40c0-a775-e9e3c10cf3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be928ca5-1018-4e0b-ae6b-e6df745b50ae', 'volume_name': 'volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847128bb-fb49-487d-a796-d383ce57d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847128bb-fb49-487d-a796-d383ce57d07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9d6a95-4cd1-4471-84e1-b4662d792644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:17 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Volume be928ca5-1018-4e0b-ae6b-e6df745b50ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae', 'volume_size': 1} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689028118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be928ca5-1018-4e0b-ae6b-e6df745b50ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22f0736ba04417ca9b6e1d9d0acb0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:18Z,use_quota=True,user_id='1c2bf4a6a45a4c4fb0f33579b91c480b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Creating volume be928ca5-1018-4e0b-ae6b-e6df745b50ae {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:17 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:17 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-91882718-f72b-4f9d-8bce-5a87e65c4266 tempest-CinderUnicodeTest-289737060 None] Created volume successfully. Aug 26 12:17:17 devstack sudo[112857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae 1073741824 Aug 26 12:17:17 devstack sudo[112857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Acquiring lock "cinder-quobyte-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Created reservations ['a17ef8dd-498f-403c-bab2-bad533f3af14', '06c62dd2-7cc7-4626-b350-d77571b4e081', '389f7315-bc36-488c-b32f-1ee46f476d29', 'ef53f551-4994-4661-b43b-8c6d0c25c531'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:17 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d1498a-94ee-4c8b-8676-1f7ba6a708a9]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:18 devstack sudo[112860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:18 devstack sudo[112860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:18 devstack sudo[112859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 Aug 26 12:17:18 devstack sudo[112859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:18 devstack sudo[112857]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae 1073741824" returned: 0 in 0.459s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:18 devstack sudo[112860]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.282s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:18 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Deleted volume successfully. Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3b653134-2af5-496c-a276-904998bd9862 tempest-CreateVolumesFromSourceVolumeTest-1802869083 None] Lock "cinder-82219c41-ea54-41a4-b9b6-6fcaa1bc472c-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:18 devstack sudo[112870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae Aug 26 12:17:18 devstack sudo[112870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:18 devstack sudo[112859]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" returned: 0 in 0.424s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:18 devstack sudo[112872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55 Aug 26 12:17:18 devstack sudo[112872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:18 devstack sudo[112870]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae" returned: 0 in 0.307s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9d6a95-4cd1-4471-84e1-b4662d792644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e071ffe-4a22-4876-8395-08668437d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:18 devstack sudo[112872]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" returned: 0 in 0.287s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:18 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Volume volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae (be928ca5-1018-4e0b-ae6b-e6df745b50ae): created successfully Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e071ffe-4a22-4876-8395-08668437d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Flow 'volume_create_manager' (dd1389d6-d934-4388-b25c-14f28334a521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-09338df4-eab3-4562-a2c9-4ecf6ee4ec55" released by "delete_volume" :: held 0.792s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:18 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6bc0358c-aafd-488e-bf80-e47ffdaa56d0 tempest-ProjectReaderTests-481744995 None] Created volume successfully. Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Created reservations ['85cc86f6-8334-4012-a411-65d5902ad72a', '067ec683-7c3b-40c7-a0ed-e06b806a23f7', '78e3c4d6-ed97-47e4-b5cc-4a6e925a9c16', '04e9afce-34c2-42b3-85bc-65602d8daf96'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:18 devstack sudo[112876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:18 devstack sudo[112876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Creating offline snapshot 398ad120-f275-4293-9b76-327db06f432e of volume 1226d09e-b8bd-48e0-93ca-c37cf9fc3201 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb25e62-48ec-4558-a70c-adad15212b16]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:19 devstack sudo[112878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 Aug 26 12:17:19 devstack sudo[112878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:19 devstack sudo[112876]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.340s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:19 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Deleted volume successfully. Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-808aebf5-801d-45fb-bbb3-b08d631189db tempest-VolumeDependencyTests-829481885 None] Lock "cinder-09338df4-eab3-4562-a2c9-4ecf6ee4ec55-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:19 devstack sudo[112878]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" returned: 0 in 0.423s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:19 devstack sudo[112885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e 1G Aug 26 12:17:19 devstack sudo[112885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Acquiring lock "cinder-be928ca5-1018-4e0b-ae6b-e6df745b50ae-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Lock "cinder-be928ca5-1018-4e0b-ae6b-e6df745b50ae-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:19 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Acquiring lock "cinder-quobyte-be928ca5-1018-4e0b-ae6b-e6df745b50ae" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Lock "cinder-quobyte-be928ca5-1018-4e0b-ae6b-e6df745b50ae" acquired by "delete_volume" :: waited 0.047s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "cinder-9c416694-9834-449b-91dc-3d91596cadca-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc41fee-94b7-4f8b-93d6-a7aeafa241eb]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:20 devstack sudo[112885]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e 1G" returned: 0 in 0.561s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Lock "cinder-9c416694-9834-449b-91dc-3d91596cadca-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:20 devstack sudo[112893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e Aug 26 12:17:20 devstack sudo[112893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "cinder-quobyte-9c416694-9834-449b-91dc-3d91596cadca" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-9c416694-9834-449b-91dc-3d91596cadca" acquired by "delete_volume" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:20 devstack sudo[112892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae Aug 26 12:17:20 devstack sudo[112892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9ac6b8-431b-446f-97e4-825f576be0da]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:20 devstack sudo[112896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca Aug 26 12:17:20 devstack sudo[112896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:20 devstack sudo[112893]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e" returned: 0 in 0.398s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:20 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e is being set with open permissions: ugo+rw Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:20 devstack sudo[112905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e Aug 26 12:17:20 devstack sudo[112905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:20 devstack sudo[112892]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae" returned: 0 in 0.486s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:20 devstack sudo[112907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae Aug 26 12:17:20 devstack sudo[112907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:20 devstack sudo[112896]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca" returned: 0 in 0.484s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:20 devstack sudo[112912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca Aug 26 12:17:20 devstack sudo[112912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:20 devstack sudo[112905]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e" returned: 0 in 0.304s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:20 devstack sudo[112907]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-be928ca5-1018-4e0b-ae6b-e6df745b50ae" returned: 0 in 0.318s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:20 devstack sudo[112916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.info Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Lock "cinder-quobyte-be928ca5-1018-4e0b-ae6b-e6df745b50ae" released by "delete_volume" :: held 0.882s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:20 devstack sudo[112916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:20 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Created reservations ['50bde64a-5a71-480f-8f0c-ab2ca272d629', 'd9ef66d7-3a7b-4b3c-a904-378a5dc1a07a', '0e014311-f82a-48de-8fcd-5a18c3ac2d8a', '3bb77616-882a-45fa-a409-078634fd3aac'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:21 devstack sudo[112912]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-9c416694-9834-449b-91dc-3d91596cadca" returned: 0 in 0.315s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Lock "cinder-quobyte-9c416694-9834-449b-91dc-3d91596cadca" released by "delete_volume" :: held 0.851s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:21 devstack sudo[112919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:21 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Created reservations ['3dcd6827-1959-41be-a770-73c72776e335', '641e38eb-4d90-4c20-9ae4-8864fce92f98', '6fa7d4e6-742b-4c7d-be0a-0edcc318c21f', '9cc99a8c-c7f1-4690-aecb-c8b02caba5dc'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:21 devstack sudo[112916]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.info" returned: 0 in 0.411s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:21 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.info is being set with open permissions: ugo+rw Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:21 devstack sudo[112922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:21 devstack sudo[112922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:21 devstack sudo[112923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.info Aug 26 12:17:21 devstack sudo[112923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:21 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.338s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Deleted volume successfully. Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6e669000-352d-48b3-84f4-c969cc0a20b5 tempest-ProjectReaderTests-481744995 None] Lock "cinder-be928ca5-1018-4e0b-ae6b-e6df745b50ae-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:21 devstack sudo[112922]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.278s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Deleted volume successfully. Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be8acfb5-3407-409a-affc-d7885aab5688 tempest-VolumeDependencyTests-829481885 None] Lock "cinder-9c416694-9834-449b-91dc-3d91596cadca-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:21 devstack sudo[112923]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.info" returned: 0 in 0.329s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.563s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-94811cda-245c-4186-94e4-68659ff7ef7e tempest-CinderUnicodeTest-289737060 None] Create snapshot completed successfully Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "cinder-398ad120-f275-4293-9b76-327db06f432e-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-398ad120-f275-4293-9b76-327db06f432e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "cinder-quobyte-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-quobyte-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "cinder-quobyte-398ad120-f275-4293-9b76-327db06f432e" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-quobyte-398ad120-f275-4293-9b76-327db06f432e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Deleting offline snapshot 398ad120-f275-4293-9b76-327db06f432e of volume 1226d09e-b8bd-48e0-93ca-c37cf9fc3201 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] snapshot_file for this snap is: volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc15079f-096a-477c-9822-9e551031e456]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:22 devstack sudo[112930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e Aug 26 12:17:22 devstack sudo[112930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Flow 'volume_create_manager' (471731b8-3969-4fa2-bc74-d910473c7b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c36a20-dc95-47b4-932f-8f51773706a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c36a20-dc95-47b4-932f-8f51773706a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1218057454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01e782c-1253-4c70-bb47-7beda9ace8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22f0736ba04417ca9b6e1d9d0acb0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:23Z,use_quota=True,user_id='1c2bf4a6a45a4c4fb0f33579b91c480b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f68a95-0748-4f7c-99c7-5d4eb8068ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f68a95-0748-4f7c-99c7-5d4eb8068ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c211a06-4dae-4b7e-bd7a-d545537a57b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c211a06-4dae-4b7e-bd7a-d545537a57b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01e782c-1253-4c70-bb47-7beda9ace8ca', 'volume_name': 'volume-b01e782c-1253-4c70-bb47-7beda9ace8ca', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d360eec5-d954-4a90-8fe5-1650d138a18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d360eec5-d954-4a90-8fe5-1650d138a18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ccbaa3-9fbf-453e-aae4-51eebea271ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:22 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Volume b01e782c-1253-4c70-bb47-7beda9ace8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01e782c-1253-4c70-bb47-7beda9ace8ca', 'volume_size': 1} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1218057454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01e782c-1253-4c70-bb47-7beda9ace8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22f0736ba04417ca9b6e1d9d0acb0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:23Z,use_quota=True,user_id='1c2bf4a6a45a4c4fb0f33579b91c480b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Creating volume b01e782c-1253-4c70-bb47-7beda9ace8ca {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:22 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:22 devstack sudo[112935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca 1073741824 Aug 26 12:17:22 devstack sudo[112935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:22 devstack sudo[112930]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e" returned: 0 in 0.582s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39c5131-a1ff-4831-b5f0-e2d00127e6a1]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:23 devstack sudo[112939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 Aug 26 12:17:23 devstack sudo[112939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:23 devstack sudo[112935]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca 1073741824" returned: 0 in 0.556s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:23 devstack sudo[112939]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" returned: 0 in 0.445s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:23 devstack sudo[112948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e Aug 26 12:17:23 devstack sudo[112948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:23 devstack sudo[112950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca Aug 26 12:17:23 devstack sudo[112950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:23 devstack sudo[112950]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca" returned: 0 in 0.334s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ccbaa3-9fbf-453e-aae4-51eebea271ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01e782c-1253-4c70-bb47-7beda9ace8ca', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4d4212-fa86-4461-ac80-d3edc562ddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:23 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Volume volume-b01e782c-1253-4c70-bb47-7beda9ace8ca (b01e782c-1253-4c70-bb47-7beda9ace8ca): created successfully Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4d4212-fa86-4461-ac80-d3edc562ddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Flow 'volume_create_manager' (471731b8-3969-4fa2-bc74-d910473c7b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-0b6ec16c-43b8-447c-82fa-85714eed349a tempest-ProjectReaderTests-481744995 None] Created volume successfully. Aug 26 12:17:23 devstack sudo[112948]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e" returned: 0 in 0.496s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:24 devstack sudo[112957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e Aug 26 12:17:24 devstack sudo[112957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:24 devstack sudo[112957]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201.398ad120-f275-4293-9b76-327db06f432e" returned: 0 in 0.284s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-quobyte-398ad120-f275-4293-9b76-327db06f432e" released by "_delete_snapshot" :: held 1.962s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-quobyte-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" released by "delete_snapshot" :: held 1.995s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Created reservations ['3de04a7f-1fbc-4675-bada-27400545a576', 'fd60ab1d-eeb7-4a1f-bb07-8a9355fa30a8', '74dbfec4-1d10-4071-b56b-b18d9e4a2908', '35ed4ebe-bf95-4a0c-98ad-f2a6961688e0'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:24 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Delete snapshot completed successfully. Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1a77c653-fd0d-40c0-bb48-0c95ca5062c4 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-398ad120-f275-4293-9b76-327db06f432e-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Acquiring lock "cinder-b01e782c-1253-4c70-bb47-7beda9ace8ca-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Lock "cinder-b01e782c-1253-4c70-bb47-7beda9ace8ca-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Acquiring lock "cinder-quobyte-b01e782c-1253-4c70-bb47-7beda9ace8ca" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Lock "cinder-quobyte-b01e782c-1253-4c70-bb47-7beda9ace8ca" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dc9872-4ef3-4c88-83a0-7873432cd918]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:25 devstack sudo[112960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca Aug 26 12:17:25 devstack sudo[112960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:25 devstack sudo[112960]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Flow 'volume_create_manager' (8f944d48-9c27-404d-aee0-fa6280c6dd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db472847-ee88-4bd0-933b-b437ad8104bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca" returned: 0 in 0.481s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db472847-ee88-4bd0-933b-b437ad8104bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8179ab7e-a968-4cb6-a34e-5ae02f01a4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0997448027474f11aeef18400d31063a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:25Z,use_quota=True,user_id='719b3dea46f04ca885b443ecef5ec4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:25 devstack sudo[112965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca Aug 26 12:17:25 devstack sudo[112965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f87b1e4-851f-4558-95b9-f3cf828422f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f87b1e4-851f-4558-95b9-f3cf828422f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224869c8-6b67-4ac7-9069-d96037af0505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.image.glance [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Creating Keystone auth plugin from conf {{(pid=94387) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "cinder-1226d09e-b8bd-48e0-93ca-c37cf9fc3201-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-1226d09e-b8bd-48e0-93ca-c37cf9fc3201-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "cinder-quobyte-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-quobyte-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" acquired by "delete_volume" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9657ac73-8964-464e-ae95-d6ad0657439e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:25 devstack sudo[112965]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-b01e782c-1253-4c70-bb47-7beda9ace8ca" returned: 0 in 0.336s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Lock "cinder-quobyte-b01e782c-1253-4c70-bb47-7beda9ace8ca" released by "delete_volume" :: held 0.875s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:25 devstack sudo[112968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Created reservations ['ddec06df-500c-4e55-a14f-1befcd086cee', 'a4b60bbf-9f15-4f52-9a64-33993082cfc4', '484769f0-37f3-4119-8d38-f7cb7070b7fd', '3e8e094d-65a4-46e9-8d41-84d7b63a49fe'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:25 devstack sudo[112968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:26 devstack sudo[112971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:26 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224869c8-6b67-4ac7-9069-d96037af0505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8179ab7e-a968-4cb6-a34e-5ae02f01a4b7', 'volume_name': 'volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7', 'volume_size': 1, 'image_id': 'b673f336-cf61-4adc-9843-5c7125f1e759', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b673f336-cf61-4adc-9843-5c7125f1e759', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e4e8e39830d9684085ddca383752c72', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0997448027474f11aeef18400d31063a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e1b53e4ae62f38d7a21f045cc80244583aa4adad167f7ff2dc83c758261207c7c166663631aad1cdaff23e060fcc0d462397f5d1171895d849d32e76a89f957', 'id': 'b673f336-cf61-4adc-9843-5c7125f1e759', 'created_at': datetime.datetime(2026, 8, 26, 10, 17, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 17, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b673f336-cf61-4adc-9843-5c7125f1e759/file', 'properties': {}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968b9aaa-cfa8-4acd-b37b-871c6e2fadaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968b9aaa-cfa8-4acd-b37b-871c6e2fadaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747781ac-a9b9-499c-bca8-3f2c7ca188d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:26 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Volume 8179ab7e-a968-4cb6-a34e-5ae02f01a4b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7', 'volume_size': 1, 'image_id': 'b673f336-cf61-4adc-9843-5c7125f1e759', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b673f336-cf61-4adc-9843-5c7125f1e759', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e4e8e39830d9684085ddca383752c72', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0997448027474f11aeef18400d31063a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e1b53e4ae62f38d7a21f045cc80244583aa4adad167f7ff2dc83c758261207c7c166663631aad1cdaff23e060fcc0d462397f5d1171895d849d32e76a89f957', 'id': 'b673f336-cf61-4adc-9843-5c7125f1e759', 'created_at': datetime.datetime(2026, 8, 26, 10, 17, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 17, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b673f336-cf61-4adc-9843-5c7125f1e759/file', 'properties': {}}, 'image_service': } Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Trying to clone 8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 from image b673f336-cf61-4adc-9843-5c7125f1e759 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b673f336-cf61-4adc-9843-5c7125f1e759', 'metadata': {}}]). {{(pid=94387) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 12:17:26 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Image download 0.00 MB at 0.00 MB/s Aug 26 12:17:26 devstack sudo[112968]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" returned: 0 in 0.643s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:26 devstack sudo[112977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201 Aug 26 12:17:26 devstack sudo[112977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[530dbe03-fd15-43c9-98f8-1056d76d0c13]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:26 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.474s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:26 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Deleted volume successfully. Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be427f69-0af4-46c7-b495-61f39a94e2e2 tempest-ProjectReaderTests-481744995 None] Lock "cinder-b01e782c-1253-4c70-bb47-7beda9ace8ca-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:26 devstack sudo[112979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD Aug 26 12:17:26 devstack sudo[112979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:26 devstack sudo[112977]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Flow 'volume_create_manager' (e15a39ed-0554-4316-87d2-180eedf79fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852717e9-885e-4741-b9a9-f079cbe3f600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" returned: 0 in 0.374s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852717e9-885e-4741-b9a9-f079cbe3f600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650318249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fc40ec-a087-4630-a8f9-daa2235ea6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22f0736ba04417ca9b6e1d9d0acb0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:27Z,use_quota=True,user_id='1c2bf4a6a45a4c4fb0f33579b91c480b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ea6f68-a42c-4302-bee6-8c533c39d262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ea6f68-a42c-4302-bee6-8c533c39d262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c3d7df-17ed-4802-988a-4405f5011048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c3d7df-17ed-4802-988a-4405f5011048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33fc40ec-a087-4630-a8f9-daa2235ea6b3', 'volume_name': 'volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bf2df4-a33e-4e6d-a1cb-363627c4ebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bf2df4-a33e-4e6d-a1cb-363627c4ebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858afb81-2bec-4831-95d6-2d140775eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:26 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Volume 33fc40ec-a087-4630-a8f9-daa2235ea6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3', 'volume_size': 1} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650318249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fc40ec-a087-4630-a8f9-daa2235ea6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22f0736ba04417ca9b6e1d9d0acb0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:27Z,use_quota=True,user_id='1c2bf4a6a45a4c4fb0f33579b91c480b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Creating volume 33fc40ec-a087-4630-a8f9-daa2235ea6b3 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:26 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-quobyte-1226d09e-b8bd-48e0-93ca-c37cf9fc3201" released by "delete_volume" :: held 1.167s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:26 devstack sudo[112983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 1073741824 Aug 26 12:17:26 devstack sudo[112983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:26 devstack sudo[112979]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Created reservations ['4d4a4c2b-0631-4d9b-96e6-547040a943cb', '5c72a217-2f37-46fb-98da-256f177bdcb0', 'e285ee83-435b-48cf-92e8-03e05a392a05', '79038a04-7cca-46bd-bccd-90a903f44f0f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:26 devstack sudo[112986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD Aug 26 12:17:26 devstack sudo[112986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:27 devstack sudo[112988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:27 devstack sudo[112988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:27 devstack sudo[112986]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Temporary image b673f336-cf61-4adc-9843-5c7125f1e759 is fetched for user 719b3dea46f04ca885b443ecef5ec4b6. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 12:17:27 devstack sudo[112988]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.286s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:27 devstack sudo[112983]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Deleted volume successfully. Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 1073741824" returned: 0 in 0.499s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-9db8366e-2529-4c70-8d39-b589069e2291 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-1226d09e-b8bd-48e0-93ca-c37cf9fc3201-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[830bb294-4a9c-4781-82db-a2bd17f50c05]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:27 devstack sudo[112999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 Aug 26 12:17:27 devstack sudo[112999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:27 devstack sudo[112998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD Aug 26 12:17:27 devstack sudo[112998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:27 devstack sudo[112999]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858afb81-2bec-4831-95d6-2d140775eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fd2b35-082b-44e0-87f9-4d522cdb3147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:27 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Volume volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 (33fc40ec-a087-4630-a8f9-daa2235ea6b3): created successfully Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fd2b35-082b-44e0-87f9-4d522cdb3147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Flow 'volume_create_manager' (e15a39ed-0554-4316-87d2-180eedf79fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-644ad648-4d02-4425-818b-4b6b8909e646 tempest-ProjectReaderTests-481744995 None] Created volume successfully. Aug 26 12:17:27 devstack sudo[112998]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "cinder-e31e4884-e25a-41ca-b077-e9cb7a27fcb1-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-e31e4884-e25a-41ca-b077-e9cb7a27fcb1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:27 devstack sudo[113005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD Aug 26 12:17:27 devstack sudo[113005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "cinder-quobyte-e31e4884-e25a-41ca-b077-e9cb7a27fcb1" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-quobyte-e31e4884-e25a-41ca-b077-e9cb7a27fcb1" acquired by "delete_volume" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d6ead-96b2-40a8-a625-a04a5a773bb3]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:28 devstack sudo[113007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 Aug 26 12:17:28 devstack sudo[113007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:28 devstack sudo[113005]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8179ab7e-a968-4cb6-a34e-5ae02f01a4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0997448027474f11aeef18400d31063a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:25Z,use_quota=True,user_id='719b3dea46f04ca885b443ecef5ec4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Creating volume 8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:28 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:28 devstack sudo[113012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 1073741824 Aug 26 12:17:28 devstack sudo[113012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:28 devstack sudo[113007]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1" returned: 0 in 0.416s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:28 devstack sudo[113019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1 Aug 26 12:17:28 devstack sudo[113019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:28 devstack sudo[113019]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:28 devstack sudo[113012]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Acquiring lock "cinder-33fc40ec-a087-4630-a8f9-daa2235ea6b3-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 1073741824" returned: 0 in 0.616s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-e31e4884-e25a-41ca-b077-e9cb7a27fcb1" returned: 0 in 0.363s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-quobyte-e31e4884-e25a-41ca-b077-e9cb7a27fcb1" released by "delete_volume" :: held 0.856s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Lock "cinder-33fc40ec-a087-4630-a8f9-daa2235ea6b3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:28 devstack sudo[113024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 Aug 26 12:17:28 devstack sudo[113024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Acquiring lock "cinder-quobyte-33fc40ec-a087-4630-a8f9-daa2235ea6b3" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Lock "cinder-quobyte-33fc40ec-a087-4630-a8f9-daa2235ea6b3" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Created reservations ['6b750cd3-cd16-4479-b04a-6fabd6be326e', '6d4ca322-5888-4917-8c36-b51c5cceac33', '6f9a75c3-4a22-4449-ab54-b1b04a61008c', '42a3277a-812d-443f-a9f6-377c6e191e67'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d048315c-abf5-4439-9e2a-f9236de7f25b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:29 devstack sudo[113027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:29 devstack sudo[113027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:29 devstack sudo[113026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 Aug 26 12:17:29 devstack sudo[113026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:29 devstack sudo[113024]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7" returned: 0 in 0.342s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Attempting download of b673f336-cf61-4adc-9843-5c7125f1e759 ((None, [{'url': 'file:///opt/stack/data/glance/images/b673f336-cf61-4adc-9843-5c7125f1e759', 'metadata': {}}])) to volume 8179ab7e-a968-4cb6-a34e-5ae02f01a4b7. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[156672f7-cfcc-4a20-8a9c-0a1daa5a3fe3]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b673f336-cf61-4adc-9843-5c7125f1e759_5mg5nbkg {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:29 devstack sudo[113027]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.324s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:29 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Deleted volume successfully. Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-be5d6861-8cd2-4c1c-b6e7-27a6d5178f63 tempest-CinderUnicodeTest-289737060 None] Lock "cinder-e31e4884-e25a-41ca-b077-e9cb7a27fcb1-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:29 devstack sudo[113031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b673f336-cf61-4adc-9843-5c7125f1e759_5mg5nbkg Aug 26 12:17:29 devstack sudo[113031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:29 devstack sudo[113026]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3" returned: 0 in 0.595s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:29 devstack sudo[113037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3 Aug 26 12:17:29 devstack sudo[113037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:29 devstack sudo[113031]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b673f336-cf61-4adc-9843-5c7125f1e759_5mg5nbkg" returned: 0 in 0.523s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b673f336-cf61-4adc-9843-5c7125f1e759_5mg5nbkg {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:29 devstack sudo[113037]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-33fc40ec-a087-4630-a8f9-daa2235ea6b3" returned: 0 in 0.374s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Lock "cinder-quobyte-33fc40ec-a087-4630-a8f9-daa2235ea6b3" released by "delete_volume" :: held 1.034s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:29 devstack sudo[113041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b673f336-cf61-4adc-9843-5c7125f1e759_5mg5nbkg Aug 26 12:17:29 devstack sudo[113041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Created reservations ['d2f83e02-2d62-4f9a-80af-1eff6c0b4ca6', 'b0ae9459-24ee-4e1c-a3ed-012d16f540dd', 'a72ecd3c-4ed8-4ec4-977b-5a8258529613', '22d9fc92-6050-472b-8b5a-107c4be0be81'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:30 devstack sudo[113044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:30 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:30 devstack sudo[113041]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b673f336-cf61-4adc-9843-5c7125f1e759_5mg5nbkg" returned: 1 in 0.505s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b673f336-cf61-4adc-9843-5c7125f1e759_5mg5nbkg' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b174d75-7afa-40c9-a96f-f19f71e7cebc]: (4, 'raw') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:30 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.290s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Deleted volume successfully. Aug 26 12:17:30 devstack sudo[113048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD Aug 26 12:17:30 devstack sudo[113048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a8f005ac-c953-43e1-bb41-bb0095d77a5c tempest-ProjectReaderTests-481744995 None] Lock "cinder-33fc40ec-a087-4630-a8f9-daa2235ea6b3-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:30 devstack sudo[113048]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:30 devstack sudo[113053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD Aug 26 12:17:30 devstack sudo[113053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:31 devstack sudo[113053]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 12:17:31 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] b673f336-cf61-4adc-9843-5c7125f1e759 was raw, converting to qcow2 {{(pid=94387) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 12:17:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:31 devstack sudo[113058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 Aug 26 12:17:31 devstack sudo[113058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:31 devstack sudo[113058]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7" returned: 0 in 0.542s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:31 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b673f336-cf61-4adc-9843-5c7125f1e759_up72io_ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:17:31 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 12:17:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:31 devstack sudo[113064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 1G Aug 26 12:17:31 devstack sudo[113064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:32 devstack sudo[113064]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 1G" returned: 0 in 0.389s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Downloaded image b673f336-cf61-4adc-9843-5c7125f1e759 ((None, [{'url': 'file:///opt/stack/data/glance/images/b673f336-cf61-4adc-9843-5c7125f1e759', 'metadata': {}}])) to volume 8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 successfully. {{(pid=94387) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Temporary image b673f336-cf61-4adc-9843-5c7125f1e759 for user 719b3dea46f04ca885b443ecef5ec4b6 is deleted. {{(pid=94387) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG cinder.volume.volume_utils [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Marking volume 8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 as bootable. {{(pid=94387) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Copying metadata from image b673f336-cf61-4adc-9843-5c7125f1e759 to 8179ab7e-a968-4cb6-a34e-5ae02f01a4b7. {{(pid=94387) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Creating volume glance metadata for volume 8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 backed by image b673f336-cf61-4adc-9843-5c7125f1e759 with: {'image_id': 'b673f336-cf61-4adc-9843-5c7125f1e759', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7e4e8e39830d9684085ddca383752c72', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94387) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747781ac-a9b9-499c-bca8-3f2c7ca188d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7', 'volume_size': 1, 'image_id': 'b673f336-cf61-4adc-9843-5c7125f1e759', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b673f336-cf61-4adc-9843-5c7125f1e759', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e4e8e39830d9684085ddca383752c72', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0997448027474f11aeef18400d31063a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e1b53e4ae62f38d7a21f045cc80244583aa4adad167f7ff2dc83c758261207c7c166663631aad1cdaff23e060fcc0d462397f5d1171895d849d32e76a89f957', 'id': 'b673f336-cf61-4adc-9843-5c7125f1e759', 'created_at': datetime.datetime(2026, 8, 26, 10, 17, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 10, 17, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b673f336-cf61-4adc-9843-5c7125f1e759/file', 'properties': {}}, 'image_service': }' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4f6d1a-6135-4b8c-9675-24f6ff1a6663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:32 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Volume volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 (8179ab7e-a968-4cb6-a34e-5ae02f01a4b7): created successfully Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4f6d1a-6135-4b8c-9675-24f6ff1a6663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:32 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Flow 'volume_create_manager' (8f944d48-9c27-404d-aee0-fa6280c6dd63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:32 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-48d9ccf3-f600-470f-a01a-9e5eb8f762f2 tempest-VolumeImageDependencyTests-2013061443 None] Created volume successfully. Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Acquiring lock "cinder-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Lock "cinder-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Acquiring lock "cinder-quobyte-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Lock "cinder-quobyte-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df77429-1e6d-416e-bdf5-06fbbac4a6fa]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:33 devstack sudo[113069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 Aug 26 12:17:33 devstack sudo[113069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:33 devstack sudo[113069]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7" returned: 0 in 0.446s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:33 devstack sudo[113110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7 Aug 26 12:17:33 devstack sudo[113110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-5e5d439e-5382-457e-8b23-eb23c6383379 tempest-ProjectAdminTests-1181017582 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8016510009766, 'free_capacity_gb': 1774.8016510009766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94387) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 12:17:33 devstack sudo[113110]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7" returned: 0 in 0.316s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Lock "cinder-quobyte-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7" released by "delete_volume" :: held 0.814s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:33 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=243,cinder:UPDATE=332,cinder:INSERT=85,cinder:DELETE=27 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Created reservations ['a75b9d3c-3c8c-4af9-b5e7-70fc385fd180', '0209aaad-bc81-433d-b8b0-f0873dcc86ec', '2d41a26c-bab5-4b04-a48c-8ba5c39fbbfb', 'b48467f2-8349-4a7a-bc01-ec51dbdb5009'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=242,cinder:UPDATE=344,cinder:DELETE=33,cinder:INSERT=91 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:34 devstack sudo[113113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:34 devstack sudo[113113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:34 devstack sudo[113113]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.283s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Deleted volume successfully. Aug 26 12:17:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4c622660-e390-4670-957f-1c172c2df60f tempest-VolumeImageDependencyTests-2013061443 None] Lock "cinder-8179ab7e-a968-4cb6-a34e-5ae02f01a4b7-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (2587fbdf-70b7-48ef-b7d7-5faa9515dde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2bfae9-f0e9-4b37-ad85-cd796cbc8425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2bfae9-f0e9-4b37-ad85-cd796cbc8425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164368776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcd5545-93cf-48f7-99a5-44315800e701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:39Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b86e158-6e73-4381-ba55-5f864c6297eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b86e158-6e73-4381-ba55-5f864c6297eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6492d3a5-b00e-4143-a6a3-b2b5ec1e24c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6492d3a5-b00e-4143-a6a3-b2b5ec1e24c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcd5545-93cf-48f7-99a5-44315800e701', 'volume_name': 'volume-5dcd5545-93cf-48f7-99a5-44315800e701', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e1da9d-8657-49a5-bda6-21fcc247130d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e1da9d-8657-49a5-bda6-21fcc247130d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97e0d11-30b2-4a05-96d6-839d75b3bcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:38 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Volume 5dcd5545-93cf-48f7-99a5-44315800e701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcd5545-93cf-48f7-99a5-44315800e701', 'volume_size': 1} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164368776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcd5545-93cf-48f7-99a5-44315800e701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:39Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Creating volume 5dcd5545-93cf-48f7-99a5-44315800e701 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:38 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:38 devstack sudo[113117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 1073741824 Aug 26 12:17:38 devstack sudo[113117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:39 devstack sudo[113117]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 1073741824" returned: 0 in 0.548s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:39 devstack sudo[113129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 Aug 26 12:17:39 devstack sudo[113129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:39 devstack sudo[113129]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701" returned: 0 in 0.296s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:39 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97e0d11-30b2-4a05-96d6-839d75b3bcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcd5545-93cf-48f7-99a5-44315800e701', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5207770e-0dc5-4b26-88d4-a9ab5fc53d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:39 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Volume volume-5dcd5545-93cf-48f7-99a5-44315800e701 (5dcd5545-93cf-48f7-99a5-44315800e701): created successfully Aug 26 12:17:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5207770e-0dc5-4b26-88d4-a9ab5fc53d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:39 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (2587fbdf-70b7-48ef-b7d7-5faa9515dde6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:39 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4eb86acc-c4d0-4af9-a6e0-a96507a24d70 tempest-ProjectMemberTests-1123874349 None] Created volume successfully. Aug 26 12:17:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:41 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Creating offline snapshot 3be46dee-4a32-416a-bb96-5c2af8931709 of volume 5dcd5545-93cf-48f7-99a5-44315800e701 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:17:41 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[256022db-45d8-4c5b-ab78-10e4746e8edf]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:41 devstack sudo[113132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 Aug 26 12:17:41 devstack sudo[113132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:41 devstack sudo[113132]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701" returned: 0 in 0.370s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:41 devstack sudo[113138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 1G Aug 26 12:17:41 devstack sudo[113138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:42 devstack sudo[113138]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 1G" returned: 0 in 0.479s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcd5545-93cf-48f7-99a5-44315800e701 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:42 devstack sudo[113144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcd5545-93cf-48f7-99a5-44315800e701 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 Aug 26 12:17:42 devstack sudo[113144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:42 devstack sudo[113144]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcd5545-93cf-48f7-99a5-44315800e701 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709" returned: 0 in 0.374s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:42 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 is being set with open permissions: ugo+rw Aug 26 12:17:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:42 devstack sudo[113149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 Aug 26 12:17:42 devstack sudo[113149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:42 devstack sudo[113149]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709" returned: 0 in 0.270s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:42 devstack sudo[113152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.info Aug 26 12:17:42 devstack sudo[113152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:42 devstack sudo[113152]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.info" returned: 0 in 0.250s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:42 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.info is being set with open permissions: ugo+rw Aug 26 12:17:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:42 devstack sudo[113155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.info Aug 26 12:17:42 devstack sudo[113155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:43 devstack sudo[113155]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.info" returned: 0 in 0.258s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-5e1bc9d9-9f02-4b77-9bab-63f89b12e343 tempest-ProjectMemberTests-1123874349 None] Create snapshot completed successfully Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-3be46dee-4a32-416a-bb96-5c2af8931709-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-3be46dee-4a32-416a-bb96-5c2af8931709-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-5dcd5545-93cf-48f7-99a5-44315800e701" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-5dcd5545-93cf-48f7-99a5-44315800e701" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-3be46dee-4a32-416a-bb96-5c2af8931709" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-3be46dee-4a32-416a-bb96-5c2af8931709" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Deleting offline snapshot 3be46dee-4a32-416a-bb96-5c2af8931709 of volume 5dcd5545-93cf-48f7-99a5-44315800e701 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] snapshot_file for this snap is: volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda462d1-f73d-41a3-b550-408e3c425d3e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:44 devstack sudo[113160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 Aug 26 12:17:44 devstack sudo[113160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:44 devstack sudo[113160]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709" returned: 0 in 0.411s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcd5545-93cf-48f7-99a5-44315800e701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e8b848-30ca-4bd9-b32c-4c81b4d97c2c]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:44 devstack sudo[113165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 Aug 26 12:17:44 devstack sudo[113165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:45 devstack sudo[113165]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701" returned: 0 in 0.382s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:45 devstack sudo[113170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 Aug 26 12:17:45 devstack sudo[113170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:45 devstack sudo[113170]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709" returned: 0 in 0.374s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:45 devstack sudo[113176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709 Aug 26 12:17:45 devstack sudo[113176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:45 devstack sudo[113176]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701.3be46dee-4a32-416a-bb96-5c2af8931709" returned: 0 in 0.254s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-3be46dee-4a32-416a-bb96-5c2af8931709" released by "_delete_snapshot" :: held 1.548s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:45 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-5dcd5545-93cf-48f7-99a5-44315800e701" released by "delete_snapshot" :: held 1.575s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:46 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Created reservations ['e3ec2d01-3cb2-43d8-a31f-dda885b1c133', 'bc83065b-bdab-4493-bf15-896498fdb131', '152554b9-8785-4e89-bd90-539cbf4e7b7a', 'cbcda0f1-7d66-45d0-9011-a80c183bb233'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:46 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Delete snapshot completed successfully. Aug 26 12:17:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-4939d081-96dd-4cb2-9c9a-060550996f62 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-3be46dee-4a32-416a-bb96-5c2af8931709-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-5dcd5545-93cf-48f7-99a5-44315800e701-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-5dcd5545-93cf-48f7-99a5-44315800e701-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-5dcd5545-93cf-48f7-99a5-44315800e701" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:46 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-5dcd5545-93cf-48f7-99a5-44315800e701" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:46 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3ea342-c21c-4f4e-9a64-f0f023aeb0e2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:46 devstack sudo[113180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 Aug 26 12:17:46 devstack sudo[113180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:47 devstack sudo[113180]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701" returned: 0 in 0.392s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:47 devstack sudo[113185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701 Aug 26 12:17:47 devstack sudo[113185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:47 devstack sudo[113185]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-5dcd5545-93cf-48f7-99a5-44315800e701" returned: 0 in 0.256s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-5dcd5545-93cf-48f7-99a5-44315800e701" released by "delete_volume" :: held 0.717s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Created reservations ['57e5c8a9-3ae2-4959-875e-5de14463938e', '0349ec7b-c6b8-4451-b8bd-7533fc00fb0a', '25ee5400-44e2-4f4e-90ec-3933dc0f094f', '6a0f97df-bf07-460f-bb0a-40808ac4c3d9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:47 devstack sudo[113188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:47 devstack sudo[113188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:47 devstack sudo[113188]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.365s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:47 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Deleted volume successfully. Aug 26 12:17:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-62348f8b-8565-47da-ab50-31720769edf0 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-5dcd5545-93cf-48f7-99a5-44315800e701-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (b8af735f-60b4-45dd-a920-1df62b84fcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68257029-1d98-4879-8c21-63262285cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68257029-1d98-4879-8c21-63262285cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767255391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ad7d58-8001-4310-a585-6adaa9f67493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:48Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b1c92a-cf93-4a8a-a48a-bef8b8ebdb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b1c92a-cf93-4a8a-a48a-bef8b8ebdb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5479d5d-d0e9-4ac0-b861-5a13d21c9430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5479d5d-d0e9-4ac0-b861-5a13d21c9430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ad7d58-8001-4310-a585-6adaa9f67493', 'volume_name': 'volume-15ad7d58-8001-4310-a585-6adaa9f67493', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eae7e92-3818-44d2-b82e-9e55e024ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eae7e92-3818-44d2-b82e-9e55e024ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c43c771-0251-4985-8c82-013ff867238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:48 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Volume 15ad7d58-8001-4310-a585-6adaa9f67493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ad7d58-8001-4310-a585-6adaa9f67493', 'volume_size': 1} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767255391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ad7d58-8001-4310-a585-6adaa9f67493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:48Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Creating volume 15ad7d58-8001-4310-a585-6adaa9f67493 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:48 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:48 devstack sudo[113191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 1073741824 Aug 26 12:17:48 devstack sudo[113191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:48 devstack sudo[113191]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 1073741824" returned: 0 in 0.530s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:48 devstack sudo[113197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 Aug 26 12:17:48 devstack sudo[113197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:49 devstack sudo[113197]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493" returned: 0 in 0.281s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:49 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c43c771-0251-4985-8c82-013ff867238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ad7d58-8001-4310-a585-6adaa9f67493', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9b2f1f-d0f5-4466-b420-18c355752ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:49 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Volume volume-15ad7d58-8001-4310-a585-6adaa9f67493 (15ad7d58-8001-4310-a585-6adaa9f67493): created successfully Aug 26 12:17:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9b2f1f-d0f5-4466-b420-18c355752ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:49 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (b8af735f-60b4-45dd-a920-1df62b84fcca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3ae305f7-598e-468e-9cf1-5bd56fc1f3cb tempest-ProjectMemberTests-1123874349 None] Created volume successfully. Aug 26 12:17:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Creating offline snapshot 79967edc-f97a-47cf-921c-d2e90377ee24 of volume 15ad7d58-8001-4310-a585-6adaa9f67493 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:17:50 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c73740-a1cb-4379-b1bf-cb06615796a2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:51 devstack sudo[113200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 Aug 26 12:17:51 devstack sudo[113200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:51 devstack sudo[113200]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493" returned: 0 in 0.383s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:51 devstack sudo[113205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 1G Aug 26 12:17:51 devstack sudo[113205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:51 devstack sudo[113205]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 1G" returned: 0 in 0.493s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ad7d58-8001-4310-a585-6adaa9f67493 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:51 devstack sudo[113211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ad7d58-8001-4310-a585-6adaa9f67493 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 Aug 26 12:17:51 devstack sudo[113211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:52 devstack sudo[113211]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ad7d58-8001-4310-a585-6adaa9f67493 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24" returned: 0 in 0.367s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:52 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 is being set with open permissions: ugo+rw Aug 26 12:17:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:52 devstack sudo[113216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 Aug 26 12:17:52 devstack sudo[113216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:52 devstack sudo[113216]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24" returned: 0 in 0.264s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:52 devstack sudo[113219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.info Aug 26 12:17:52 devstack sudo[113219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:52 devstack sudo[113219]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.info" returned: 0 in 0.292s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:52 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.info is being set with open permissions: ugo+rw Aug 26 12:17:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:52 devstack sudo[113222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.info Aug 26 12:17:52 devstack sudo[113222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:53 devstack sudo[113222]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.info" returned: 0 in 0.301s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:53 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-80989a79-e113-4f21-9dc3-1926ef3773e1 tempest-ProjectMemberTests-1123874349 None] Create snapshot completed successfully Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-79967edc-f97a-47cf-921c-d2e90377ee24-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-79967edc-f97a-47cf-921c-d2e90377ee24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-15ad7d58-8001-4310-a585-6adaa9f67493" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-15ad7d58-8001-4310-a585-6adaa9f67493" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-79967edc-f97a-47cf-921c-d2e90377ee24" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-79967edc-f97a-47cf-921c-d2e90377ee24" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Deleting offline snapshot 79967edc-f97a-47cf-921c-d2e90377ee24 of volume 15ad7d58-8001-4310-a585-6adaa9f67493 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] snapshot_file for this snap is: volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec80f96c-5c73-4010-a776-57d379a40060]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:54 devstack sudo[113225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 Aug 26 12:17:54 devstack sudo[113225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:54 devstack sudo[113225]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24" returned: 0 in 0.522s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ad7d58-8001-4310-a585-6adaa9f67493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faebc09-eb87-4aa8-9cdd-788ebd7972a7]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:54 devstack sudo[113230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 Aug 26 12:17:54 devstack sudo[113230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:55 devstack sudo[113230]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493" returned: 0 in 0.422s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:55 devstack sudo[113236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 Aug 26 12:17:55 devstack sudo[113236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:55 devstack sudo[113236]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24" returned: 0 in 0.426s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:55 devstack sudo[113241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24 Aug 26 12:17:55 devstack sudo[113241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:55 devstack sudo[113241]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493.79967edc-f97a-47cf-921c-d2e90377ee24" returned: 0 in 0.254s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:55 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-79967edc-f97a-47cf-921c-d2e90377ee24" released by "_delete_snapshot" :: held 1.795s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:55 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-15ad7d58-8001-4310-a585-6adaa9f67493" released by "delete_snapshot" :: held 1.817s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:55 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Created reservations ['790be41b-f725-4063-a605-7c23fdf7fc88', '14d95609-d974-475c-bf77-6670e3b2b6eb', '8ce42b55-af0a-4a10-9f4a-3dbafacdd0c2', 'b82ca15c-f19f-408d-9887-6511867e18a1'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:56 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Delete snapshot completed successfully. Aug 26 12:17:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa842314-98c0-4579-9c32-972b880b1cd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-79967edc-f97a-47cf-921c-d2e90377ee24-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-15ad7d58-8001-4310-a585-6adaa9f67493-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-15ad7d58-8001-4310-a585-6adaa9f67493-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-15ad7d58-8001-4310-a585-6adaa9f67493" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:17:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-15ad7d58-8001-4310-a585-6adaa9f67493" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:17:56 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[c669ea60-4217-456e-825f-16a251460cb8]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:56 devstack sudo[113245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 Aug 26 12:17:56 devstack sudo[113245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:56 devstack sudo[113245]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493" returned: 0 in 0.385s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:56 devstack sudo[113250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493 Aug 26 12:17:56 devstack sudo[113250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:57 devstack sudo[113250]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-15ad7d58-8001-4310-a585-6adaa9f67493" returned: 0 in 0.254s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-15ad7d58-8001-4310-a585-6adaa9f67493" released by "delete_volume" :: held 0.703s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Created reservations ['73bce4db-4dd4-4661-ab2d-130510a1fbb2', '0bbfa22e-2755-4001-99bb-fb53f0024c12', '6fd6595b-9f90-4881-aad9-7dd2a327b658', '61cf2734-e33d-4cdc-a96a-6a2c6d21cb50'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:57 devstack sudo[113253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:17:57 devstack sudo[113253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:57 devstack sudo[113253]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.272s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:17:57 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Deleted volume successfully. Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a5d002c0-75ed-412b-b1ad-589844024115 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-15ad7d58-8001-4310-a585-6adaa9f67493-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (6bb852fe-0924-4b37-a199-5854dd87724f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:57 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0dd32e-a089-4066-aa94-1257d4f73c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0dd32e-a089-4066-aa94-1257d4f73c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044366312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c69d0f-b832-4c48-b5ed-ad6d25577e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:58Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d62818-0cac-4d29-973c-8dd37b1cdf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d62818-0cac-4d29-973c-8dd37b1cdf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d377a8-34e6-41f4-a65a-37b637e699c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d377a8-34e6-41f4-a65a-37b637e699c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c69d0f-b832-4c48-b5ed-ad6d25577e1c', 'volume_name': 'volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2262ea76-394b-48ee-8a24-5e935e8174e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2262ea76-394b-48ee-8a24-5e935e8174e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e727c52b-1710-4e0f-bb98-bbaedea1925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Volume 19c69d0f-b832-4c48-b5ed-ad6d25577e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c', 'volume_size': 1} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044366312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c69d0f-b832-4c48-b5ed-ad6d25577e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:17:58Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Creating volume 19c69d0f-b832-4c48-b5ed-ad6d25577e1c {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:17:58 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:58 devstack sudo[113256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c 1073741824 Aug 26 12:17:58 devstack sudo[113256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:58 devstack sudo[113256]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c 1073741824" returned: 0 in 0.451s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:58 devstack sudo[113262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c Aug 26 12:17:58 devstack sudo[113262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:58 devstack sudo[113262]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" returned: 0 in 0.264s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e727c52b-1710-4e0f-bb98-bbaedea1925b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cecceb-075b-496d-9ef8-8bb60ff8a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:17:58 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Volume volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c (19c69d0f-b832-4c48-b5ed-ad6d25577e1c): created successfully Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cecceb-075b-496d-9ef8-8bb60ff8a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:17:58 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (6bb852fe-0924-4b37-a199-5854dd87724f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:17:58 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2a255634-c4e0-4db9-ad60-492fd93c4e3c tempest-ProjectMemberTests-1123874349 None] Created volume successfully. Aug 26 12:17:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:17:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:17:59 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Creating offline snapshot 897c4be8-96d9-4009-8763-40f4b5145839 of volume 19c69d0f-b832-4c48-b5ed-ad6d25577e1c {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:17:59 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[119df0c3-ae2f-406f-9d7e-3e320797cc24]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:17:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:59 devstack sudo[113265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c Aug 26 12:17:59 devstack sudo[113265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:17:59 devstack sudo[113265]: pam_unix(sudo:session): session closed for user root Aug 26 12:17:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" returned: 0 in 0.366s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:17:59 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:17:59 devstack sudo[113270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 1G Aug 26 12:17:59 devstack sudo[113270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:00 devstack sudo[113270]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 1G" returned: 0 in 0.454s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:00 devstack sudo[113276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 Aug 26 12:18:00 devstack sudo[113276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:00 devstack sudo[113276]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839" returned: 0 in 0.364s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:00 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 is being set with open permissions: ugo+rw Aug 26 12:18:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:00 devstack sudo[113281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 Aug 26 12:18:00 devstack sudo[113281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:00 devstack sudo[113281]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839" returned: 0 in 0.284s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:00 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:00 devstack sudo[113284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.info Aug 26 12:18:00 devstack sudo[113284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:00 devstack sudo[113284]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.info" returned: 0 in 0.290s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:01 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.info is being set with open permissions: ugo+rw Aug 26 12:18:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:01 devstack sudo[113287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.info Aug 26 12:18:01 devstack sudo[113287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:01 devstack sudo[113287]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.info" returned: 0 in 0.262s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:01 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-4d9346df-10c0-414e-93bc-d07deccf2f11 tempest-ProjectMemberTests-1123874349 None] Create snapshot completed successfully Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-897c4be8-96d9-4009-8763-40f4b5145839-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-897c4be8-96d9-4009-8763-40f4b5145839-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-897c4be8-96d9-4009-8763-40f4b5145839" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-897c4be8-96d9-4009-8763-40f4b5145839" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Deleting offline snapshot 897c4be8-96d9-4009-8763-40f4b5145839 of volume 19c69d0f-b832-4c48-b5ed-ad6d25577e1c {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] snapshot_file for this snap is: volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[4862da1a-c8e0-4753-a4ac-69a6d433dca5]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:02 devstack sudo[113290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 Aug 26 12:18:02 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:02 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839" returned: 0 in 0.401s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8f7a1e-de34-400b-92f3-7295ef0a3cd0]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:02 devstack sudo[113295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c Aug 26 12:18:02 devstack sudo[113295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:03 devstack sudo[113295]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" returned: 0 in 0.367s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:03 devstack sudo[113300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 Aug 26 12:18:03 devstack sudo[113300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:03 devstack sudo[113300]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839" returned: 0 in 0.374s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:03 devstack sudo[113306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839 Aug 26 12:18:03 devstack sudo[113306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:03 devstack sudo[113306]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c.897c4be8-96d9-4009-8763-40f4b5145839" returned: 0 in 0.266s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-897c4be8-96d9-4009-8763-40f4b5145839" released by "_delete_snapshot" :: held 1.514s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:03 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" released by "delete_snapshot" :: held 1.544s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:04 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Created reservations ['6f9bc141-ee8d-4b7a-84cb-9cace33952cb', 'd3e7062b-6e04-4bb2-b958-cd906f876774', '01b03f81-fee4-41f9-b6b1-f4ddd04b07a1', '11116398-2ca8-4517-9acf-0551a5225786'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:04 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Delete snapshot completed successfully. Aug 26 12:18:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-1682e9f4-d6f3-43eb-ac1a-0d34f321a87b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-897c4be8-96d9-4009-8763-40f4b5145839-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-19c69d0f-b832-4c48-b5ed-ad6d25577e1c-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-19c69d0f-b832-4c48-b5ed-ad6d25577e1c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" acquired by "delete_volume" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:04 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[9979f85e-6f2a-4760-a324-28379a893f8b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:04 devstack sudo[113310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c Aug 26 12:18:04 devstack sudo[113310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:05 devstack sudo[113310]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" returned: 0 in 0.366s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:05 devstack sudo[113315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c Aug 26 12:18:05 devstack sudo[113315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:05 devstack sudo[113315]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" returned: 0 in 0.257s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-19c69d0f-b832-4c48-b5ed-ad6d25577e1c" released by "delete_volume" :: held 0.686s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Created reservations ['d99b62dd-51a7-4489-ac17-399446f45e93', '46796773-3cf8-4839-8776-b05314d5d746', 'ab153653-1a17-4c57-9a93-f0f739f8579c', 'de71713f-245d-414f-8870-fdab93f5d6a6'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:05 devstack sudo[113318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:05 devstack sudo[113318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:05 devstack sudo[113318]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.366s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:05 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Deleted volume successfully. Aug 26 12:18:05 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d9c98074-927c-4c7e-a923-7a1b282bf2a2 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-19c69d0f-b832-4c48-b5ed-ad6d25577e1c-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (ab6f25e2-ef6f-4721-a426-d3b13d220bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86efbee-42f1-40a2-ac47-3ac4373213e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86efbee-42f1-40a2-ac47-3ac4373213e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1266204101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a59d703-c6a5-4707-ae7a-949128560f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:06Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c6ca4a-5431-43f5-b90b-c28740b97d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c6ca4a-5431-43f5-b90b-c28740b97d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d130a50-512c-42ea-b7a7-3c31793b8661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d130a50-512c-42ea-b7a7-3c31793b8661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a59d703-c6a5-4707-ae7a-949128560f7e', 'volume_name': 'volume-8a59d703-c6a5-4707-ae7a-949128560f7e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61679ff0-9df7-4297-87fa-ce6048abb8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61679ff0-9df7-4297-87fa-ce6048abb8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1c8351-8f92-4f40-82e2-2680f7d6bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:06 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Volume 8a59d703-c6a5-4707-ae7a-949128560f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a59d703-c6a5-4707-ae7a-949128560f7e', 'volume_size': 1} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1266204101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a59d703-c6a5-4707-ae7a-949128560f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:06Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Creating volume 8a59d703-c6a5-4707-ae7a-949128560f7e {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:18:06 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:06 devstack sudo[113322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e 1073741824 Aug 26 12:18:06 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:06 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e 1073741824" returned: 0 in 0.494s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:06 devstack sudo[113328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e Aug 26 12:18:06 devstack sudo[113328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:07 devstack sudo[113328]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e" returned: 0 in 0.256s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:18:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1c8351-8f92-4f40-82e2-2680f7d6bffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a59d703-c6a5-4707-ae7a-949128560f7e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d50bb91-66de-4bd8-b4dd-6d7d4a36e9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:07 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Volume volume-8a59d703-c6a5-4707-ae7a-949128560f7e (8a59d703-c6a5-4707-ae7a-949128560f7e): created successfully Aug 26 12:18:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d50bb91-66de-4bd8-b4dd-6d7d4a36e9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:07 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (ab6f25e2-ef6f-4721-a426-d3b13d220bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:07 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c658be14-02cc-4fba-a4c6-ce247b972345 tempest-ProjectMemberTests-1123874349 None] Created volume successfully. Aug 26 12:18:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Creating offline snapshot 9558fee4-8adc-4932-8abc-65eecfabff3f of volume 8a59d703-c6a5-4707-ae7a-949128560f7e {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:18:08 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17d010-b890-45fc-940e-f28283ec0df5]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:08 devstack sudo[113331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e Aug 26 12:18:08 devstack sudo[113331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:08 devstack sudo[113331]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e" returned: 0 in 0.408s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:08 devstack sudo[113336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f 1G Aug 26 12:18:08 devstack sudo[113336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:09 devstack sudo[113336]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f 1G" returned: 0 in 0.437s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a59d703-c6a5-4707-ae7a-949128560f7e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:09 devstack sudo[113342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a59d703-c6a5-4707-ae7a-949128560f7e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f Aug 26 12:18:09 devstack sudo[113342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:09 devstack sudo[113342]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a59d703-c6a5-4707-ae7a-949128560f7e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:09 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f is being set with open permissions: ugo+rw Aug 26 12:18:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:09 devstack sudo[113347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f Aug 26 12:18:09 devstack sudo[113347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:10 devstack sudo[113347]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f" returned: 0 in 0.273s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:10 devstack sudo[113350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.info Aug 26 12:18:10 devstack sudo[113350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:10 devstack sudo[113350]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.info" returned: 0 in 0.300s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:10 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.info is being set with open permissions: ugo+rw Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:10 devstack sudo[113353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.info Aug 26 12:18:10 devstack sudo[113353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:10 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:10 devstack sudo[113353]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:10 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.info" returned: 0 in 0.257s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:10 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f75d8e7e-634e-4b36-a601-191b53e6aaf8 tempest-ProjectMemberTests-1123874349 None] Create snapshot completed successfully Aug 26 12:18:10 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.306s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Flow 'volume_create_manager' (a3842961-4b1b-4b95-a5aa-190b587626b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef141da2-17ed-4471-8d8a-972bfab223d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef141da2-17ed-4471-8d8a-972bfab223d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-595759909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0070d847-10ad-46b2-9a7b-a83b7f3bb61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cde5b7775041f4b76079b655078f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:11Z,use_quota=True,user_id='1f01ca0bf8f44d59be7542b6e62cb5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e87d18-6db1-4c5a-b341-6c06888d5231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e87d18-6db1-4c5a-b341-6c06888d5231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c051126f-528d-485a-98ae-f3035e06e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c051126f-528d-485a-98ae-f3035e06e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0070d847-10ad-46b2-9a7b-a83b7f3bb61d', 'volume_name': 'volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d0de50-e6ce-4f93-9d18-13a28346e396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d0de50-e6ce-4f93-9d18-13a28346e396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78036255-1657-4ad8-b123-46194a93f0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:11 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Volume 0070d847-10ad-46b2-9a7b-a83b7f3bb61d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d', 'volume_size': 1} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-595759909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0070d847-10ad-46b2-9a7b-a83b7f3bb61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cde5b7775041f4b76079b655078f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:11Z,use_quota=True,user_id='1f01ca0bf8f44d59be7542b6e62cb5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Creating volume 0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:18:11 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:11 devstack sudo[113359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d 1073741824 Aug 26 12:18:11 devstack sudo[113359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:11 devstack sudo[113359]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d 1073741824" returned: 0 in 0.408s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:11 devstack sudo[113365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d Aug 26 12:18:11 devstack sudo[113365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-9558fee4-8adc-4932-8abc-65eecfabff3f-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-9558fee4-8adc-4932-8abc-65eecfabff3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-8a59d703-c6a5-4707-ae7a-949128560f7e" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-8a59d703-c6a5-4707-ae7a-949128560f7e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-9558fee4-8adc-4932-8abc-65eecfabff3f" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:11 devstack sudo[113365]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" returned: 0 in 0.270s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-9558fee4-8adc-4932-8abc-65eecfabff3f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Deleting offline snapshot 9558fee4-8adc-4932-8abc-65eecfabff3f of volume 8a59d703-c6a5-4707-ae7a-949128560f7e {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] snapshot_file for this snap is: volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb97597e-5424-4258-bf36-32b3bab65cfa]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78036255-1657-4ad8-b123-46194a93f0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09d2ba7-4342-4cc1-9b7a-df5a42ed7276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:11 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Volume volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d (0070d847-10ad-46b2-9a7b-a83b7f3bb61d): created successfully Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09d2ba7-4342-4cc1-9b7a-df5a42ed7276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:11 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Flow 'volume_create_manager' (a3842961-4b1b-4b95-a5aa-190b587626b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:11 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-2a70dfa7-66e0-452f-af35-cbae740a3cd6 tempest-SnapshotDependencyTests-577021388 None] Created volume successfully. Aug 26 12:18:11 devstack sudo[113368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f Aug 26 12:18:11 devstack sudo[113368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:12 devstack sudo[113368]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f" returned: 0 in 0.386s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a59d703-c6a5-4707-ae7a-949128560f7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0126c9-14d2-4d1f-9673-89af6d09babd]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Creating offline snapshot 3bed4b43-c040-4a4c-9b29-a970914c907e of volume 0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[886a31f4-1009-452c-9c62-ed5473e6be40]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:12 devstack sudo[113373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e Aug 26 12:18:12 devstack sudo[113373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:12 devstack sudo[113374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d Aug 26 12:18:12 devstack sudo[113374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:12 devstack sudo[113373]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e" returned: 0 in 0.390s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:12 devstack sudo[113383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f Aug 26 12:18:12 devstack sudo[113383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:12 devstack sudo[113374]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" returned: 0 in 0.373s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:12 devstack sudo[113385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e 1G Aug 26 12:18:12 devstack sudo[113385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:12 devstack sudo[113383]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f" returned: 0 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:12 devstack sudo[113393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f Aug 26 12:18:12 devstack sudo[113393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:13 devstack sudo[113385]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e 1G" returned: 0 in 0.421s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:13 devstack sudo[113396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e Aug 26 12:18:13 devstack sudo[113396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:13 devstack sudo[113393]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e.9558fee4-8adc-4932-8abc-65eecfabff3f" returned: 0 in 0.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-9558fee4-8adc-4932-8abc-65eecfabff3f" released by "_delete_snapshot" :: held 1.488s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-8a59d703-c6a5-4707-ae7a-949128560f7e" released by "delete_snapshot" :: held 1.514s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Created reservations ['2292dc5b-9b9b-4435-8886-cb135faba099', 'd293902e-9ece-4f93-81c5-b012d062223b', 'fe7844dc-195c-46b7-af47-3a9cac749102', '8247af66-75fb-4e5d-a75f-357114a645f6'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:13 devstack sudo[113396]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e" returned: 0 in 0.318s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:13 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e is being set with open permissions: ugo+rw Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Delete snapshot completed successfully. Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-f8a772af-1dbf-4407-bcdc-4072b3bebfd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-9558fee4-8adc-4932-8abc-65eecfabff3f-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:13 devstack sudo[113402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e Aug 26 12:18:13 devstack sudo[113402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:13 devstack sudo[113402]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e" returned: 0 in 0.244s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:13 devstack sudo[113405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.info Aug 26 12:18:13 devstack sudo[113405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-8a59d703-c6a5-4707-ae7a-949128560f7e-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-8a59d703-c6a5-4707-ae7a-949128560f7e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:13 devstack sudo[113405]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.info" returned: 0 in 0.274s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:13 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.info is being set with open permissions: ugo+rw Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-8a59d703-c6a5-4707-ae7a-949128560f7e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:13 devstack sudo[113408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.info Aug 26 12:18:13 devstack sudo[113408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-8a59d703-c6a5-4707-ae7a-949128560f7e" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b48cbc-18d9-4191-b6b8-2f970e1ca401]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:14 devstack sudo[113410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e Aug 26 12:18:14 devstack sudo[113410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:14 devstack sudo[113408]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.info" returned: 0 in 0.256s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:14 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b2fa3c3f-357c-43ed-bbcb-44bf04085268 tempest-SnapshotDependencyTests-577021388 None] Create snapshot completed successfully Aug 26 12:18:14 devstack sudo[113410]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e" returned: 0 in 0.364s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:14 devstack sudo[113416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e Aug 26 12:18:14 devstack sudo[113416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:14 devstack sudo[113416]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8a59d703-c6a5-4707-ae7a-949128560f7e" returned: 0 in 0.260s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-8a59d703-c6a5-4707-ae7a-949128560f7e" released by "delete_volume" :: held 0.688s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Created reservations ['721ab43f-6a79-492e-b433-8897a5d968d5', '19733c93-0d9c-47ca-be70-3b4367cd0f05', 'b4e05d72-0f25-442c-8abd-eddb96293a9c', 'e27acfec-eda6-4c06-af04-30470ecc63e1'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:14 devstack sudo[113419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:14 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:14 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.247s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Deleted volume successfully. Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-52e56c1a-d327-42d1-ad15-b12976bfebb3 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-8a59d703-c6a5-4707-ae7a-949128560f7e-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (9809f109-884f-4d89-95de-23ed387abc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec18262-4186-4692-8956-1ad51616f44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec18262-4186-4692-8956-1ad51616f44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250527394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b029963-6b22-48bc-b62c-0c98bff38f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:15Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2ca94a-930e-4547-9c3b-546dcb18beeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2ca94a-930e-4547-9c3b-546dcb18beeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca46b2f-bb74-4d5f-b5d6-565d6b2a274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca46b2f-bb74-4d5f-b5d6-565d6b2a274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b029963-6b22-48bc-b62c-0c98bff38f1e', 'volume_name': 'volume-8b029963-6b22-48bc-b62c-0c98bff38f1e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db6e1b3-07b6-4662-98af-51af0cdf6341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db6e1b3-07b6-4662-98af-51af0cdf6341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d230e2-370f-47d6-850f-3b064af2b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:15 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Volume 8b029963-6b22-48bc-b62c-0c98bff38f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b029963-6b22-48bc-b62c-0c98bff38f1e', 'volume_size': 1} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250527394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b029963-6b22-48bc-b62c-0c98bff38f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:15Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Creating volume 8b029963-6b22-48bc-b62c-0c98bff38f1e {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:18:15 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:15 devstack sudo[113422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e 1073741824 Aug 26 12:18:15 devstack sudo[113422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Flow 'volume_create_manager' (2e957afe-a222-4bc4-81a3-2ece90de312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47e8b16-4eab-4edc-9803-b5b0e7bbe14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47e8b16-4eab-4edc-9803-b5b0e7bbe14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cde5b7775041f4b76079b655078f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3bed4b43-c040-4a4c-9b29-a970914c907e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:16Z,use_quota=True,user_id='1f01ca0bf8f44d59be7542b6e62cb5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745649eb-212e-4fd0-8b80-5aa1769bea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745649eb-212e-4fd0-8b80-5aa1769bea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3623af55-d2b0-49e0-9cab-7bc869b0dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3623af55-d2b0-49e0-9cab-7bc869b0dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd', 'volume_name': 'volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd', 'volume_size': 1, 'snapshot_id': '3bed4b43-c040-4a4c-9b29-a970914c907e'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:16 devstack sudo[113422]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63299956-2f2f-4251-8fe0-f4adeda63d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63299956-2f2f-4251-8fe0-f4adeda63d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd14933e-f500-450a-ba34-bad3d570ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:16 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Volume 1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd', 'volume_size': 1, 'snapshot_id': '3bed4b43-c040-4a4c-9b29-a970914c907e'} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e 1073741824" returned: 0 in 0.481s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:16 devstack sudo[113429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e Aug 26 12:18:16 devstack sudo[113429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:16 devstack sudo[113429]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e" returned: 0 in 0.246s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.276s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "cinder-quobyte-3bed4b43-c040-4a4c-9b29-a970914c907e-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" by "_create_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d230e2-370f-47d6-850f-3b064af2b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b029963-6b22-48bc-b62c-0c98bff38f1e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deacc4b6-47ac-43b2-88ca-910255d6ad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-3bed4b43-c040-4a4c-9b29-a970914c907e-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Creating volume 1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd from snapshot 3bed4b43-c040-4a4c-9b29-a970914c907e {{(pid=94387) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "cinder-quobyte-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" by "_copy_volume_from_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:16 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Volume volume-8b029963-6b22-48bc-b62c-0c98bff38f1e (8b029963-6b22-48bc-b62c-0c98bff38f1e): created successfully Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deacc4b6-47ac-43b2-88ca-910255d6ad90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (9809f109-884f-4d89-95de-23ed387abc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] snapshot: 3bed4b43-c040-4a4c-9b29-a970914c907e, volume: 1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd, {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 12:18:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-eb4fc328-1749-4bb9-b958-0646ccbd2d40 tempest-ProjectMemberTests-1123874349 None] Created volume successfully. Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf50f69-d60b-4b81-9f64-b0ecd1fd8358]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:16 devstack sudo[113432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e Aug 26 12:18:16 devstack sudo[113432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:16 devstack sudo[113432]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e" returned: 0 in 0.367s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[12921c0d-4d86-438b-85c5-98edd0e562af]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:16 devstack sudo[113437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d Aug 26 12:18:16 devstack sudo[113437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:17 devstack sudo[113437]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 12:18:17 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Creating direct copy from snapshot {{(pid=94387) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 12:18:17 devstack cinder-volume[94387]: DEBUG cinder.utils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Path /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd not found in is_blk_device check {{(pid=94387) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 12:18:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:17 devstack sudo[113442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd Aug 26 12:18:17 devstack sudo[113442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:21 devstack sudo[113442]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" returned: 0 in 4.329s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG cinder.image.image_utils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Image conversion details: src /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd {{(pid=94387) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 12:18:21 devstack cinder-volume[94387]: INFO cinder.image.image_utils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Converted 1024.00 MB image at 236.51 MB/s Aug 26 12:18:21 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd is being set with open permissions: ugo+rw Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:21 devstack sudo[113455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd Aug 26 12:18:21 devstack sudo[113455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:21 devstack sudo[113455]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" returned: 0 in 0.240s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" released by "_copy_volume_from_snapshot" :: held 5.373s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-3bed4b43-c040-4a4c-9b29-a970914c907e-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" released by "_create_volume_from_snapshot" :: held 5.447s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.482s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.065s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Creating offline snapshot 2c212224-fe0e-4b64-92cf-825d0126a4cb of volume 8b029963-6b22-48bc-b62c-0c98bff38f1e {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd14933e-f500-450a-ba34-bad3d570ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd', 'volume_size': 1, 'snapshot_id': '3bed4b43-c040-4a4c-9b29-a970914c907e'}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9261ff7d-740c-402b-9d4b-6df25495af1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d819784-a853-4f79-a621-331bd27037da]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:21 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Volume volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd (1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd): created successfully Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9261ff7d-740c-402b-9d4b-6df25495af1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:21 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Flow 'volume_create_manager' (2e957afe-a222-4bc4-81a3-2ece90de312d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:21 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d244e050-c191-4716-856c-f0a01ec3b52d tempest-SnapshotDependencyTests-577021388 None] Created volume successfully. Aug 26 12:18:21 devstack sudo[113458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e Aug 26 12:18:21 devstack sudo[113458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:22 devstack sudo[113458]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e" returned: 0 in 0.362s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:22 devstack sudo[113463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb 1G Aug 26 12:18:22 devstack sudo[113463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "cinder-3bed4b43-c040-4a4c-9b29-a970914c907e-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-3bed4b43-c040-4a4c-9b29-a970914c907e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "cinder-quobyte-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "cinder-quobyte-3bed4b43-c040-4a4c-9b29-a970914c907e" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-3bed4b43-c040-4a4c-9b29-a970914c907e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Deleting offline snapshot 3bed4b43-c040-4a4c-9b29-a970914c907e of volume 0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] snapshot_file for this snap is: volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da04690-5ce5-445c-846c-701b037f4d02]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:22 devstack sudo[113463]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb 1G" returned: 0 in 0.446s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b029963-6b22-48bc-b62c-0c98bff38f1e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:22 devstack sudo[113469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b029963-6b22-48bc-b62c-0c98bff38f1e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb Aug 26 12:18:22 devstack sudo[113469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:22 devstack sudo[113468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e Aug 26 12:18:22 devstack sudo[113468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:22 devstack sudo[113469]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b029963-6b22-48bc-b62c-0c98bff38f1e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb" returned: 0 in 0.296s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:22 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb is being set with open permissions: ugo+rw Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:22 devstack sudo[113468]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e" returned: 0 in 0.370s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:18:22 devstack sudo[113478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb Aug 26 12:18:23 devstack sudo[113478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[61639f6a-af66-48b3-ab5b-4513a56390af]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:23 devstack sudo[113480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d Aug 26 12:18:23 devstack sudo[113480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:23 devstack sudo[113478]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb" returned: 0 in 0.247s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:23 devstack sudo[113483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.info Aug 26 12:18:23 devstack sudo[113483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:23 devstack sudo[113483]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.info" returned: 0 in 0.255s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:23 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.info is being set with open permissions: ugo+rw Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:23 devstack sudo[113488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.info Aug 26 12:18:23 devstack sudo[113488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:23 devstack sudo[113480]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" returned: 0 in 0.571s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:23 devstack sudo[113491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e Aug 26 12:18:23 devstack sudo[113491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:23 devstack sudo[113488]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.info" returned: 0 in 0.268s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f2786eff-bf39-4619-a173-dea62bb4a15d tempest-ProjectMemberTests-1123874349 None] Create snapshot completed successfully Aug 26 12:18:23 devstack sudo[113491]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e" returned: 0 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:23 devstack sudo[113497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e Aug 26 12:18:23 devstack sudo[113497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-2c212224-fe0e-4b64-92cf-825d0126a4cb-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-2c212224-fe0e-4b64-92cf-825d0126a4cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-8b029963-6b22-48bc-b62c-0c98bff38f1e" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-8b029963-6b22-48bc-b62c-0c98bff38f1e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-2c212224-fe0e-4b64-92cf-825d0126a4cb" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-2c212224-fe0e-4b64-92cf-825d0126a4cb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Deleting offline snapshot 2c212224-fe0e-4b64-92cf-825d0126a4cb of volume 8b029963-6b22-48bc-b62c-0c98bff38f1e {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:18:24 devstack sudo[113497]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] snapshot_file for this snap is: volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d.3bed4b43-c040-4a4c-9b29-a970914c907e" returned: 0 in 0.296s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d8649-7e92-4882-b5a7-934f9831444b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-3bed4b43-c040-4a4c-9b29-a970914c907e" released by "_delete_snapshot" :: held 1.709s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" released by "delete_snapshot" :: held 1.742s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:24 devstack sudo[113500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb Aug 26 12:18:24 devstack sudo[113500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Created reservations ['298aff57-ae6e-4994-8f39-88bdd3eee171', '25f83e51-2d6c-49cc-9fad-702b79d09f24', '4b869e78-3759-462f-8382-5f63900344a6', '027b6891-c41f-4015-818c-f77108a5bb9e'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:24 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Delete snapshot completed successfully. Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-af622010-8d73-49c1-95e5-801459e9f1d9 tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-3bed4b43-c040-4a4c-9b29-a970914c907e-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:24 devstack sudo[113500]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb" returned: 0 in 0.369s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b029963-6b22-48bc-b62c-0c98bff38f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccb04e2-2541-4932-a3ac-0a60b61a0466]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "cinder-0070d847-10ad-46b2-9a7b-a83b7f3bb61d-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-0070d847-10ad-46b2-9a7b-a83b7f3bb61d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "cinder-quobyte-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" acquired by "delete_volume" :: waited 0.027s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:24 devstack sudo[113505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e Aug 26 12:18:24 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c4c320-a2d3-4796-b82a-6a67488d1709]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:24 devstack sudo[113507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d Aug 26 12:18:24 devstack sudo[113507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:25 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e" returned: 0 in 0.393s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:25 devstack sudo[113513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb Aug 26 12:18:25 devstack sudo[113513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:25 devstack sudo[113507]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" returned: 0 in 0.374s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:25 devstack sudo[113518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d Aug 26 12:18:25 devstack sudo[113518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:25 devstack sudo[113513]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb" returned: 0 in 0.359s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:25 devstack sudo[113524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb Aug 26 12:18:25 devstack sudo[113524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:25 devstack sudo[113518]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" returned: 0 in 0.259s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-0070d847-10ad-46b2-9a7b-a83b7f3bb61d" released by "delete_volume" :: held 0.693s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Created reservations ['1c7d7e44-15fd-4e13-a399-f7ec957f7bb5', '17b171e4-eb8b-4708-83f3-9d7ec3352c70', '300112e1-ae69-4bbb-8700-f101cdcd790b', 'da6dfbd3-0b0b-4a79-b48e-11f99e3cbc67'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:25 devstack sudo[113526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:25 devstack sudo[113526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:25 devstack sudo[113524]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e.2c212224-fe0e-4b64-92cf-825d0126a4cb" returned: 0 in 0.251s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-2c212224-fe0e-4b64-92cf-825d0126a4cb" released by "_delete_snapshot" :: held 1.481s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-8b029963-6b22-48bc-b62c-0c98bff38f1e" released by "delete_snapshot" :: held 1.507s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Created reservations ['55eb69e4-1e8f-4f9d-9712-a1882138756e', 'ef87b928-f769-4876-9349-98d5b0c05d11', '47bf09b8-39b9-40a8-8d4f-7e064dd35346', '9868ed92-b214-4cb9-836a-1f098919aa13'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Delete snapshot completed successfully. Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a7dee407-c799-44ba-a410-ccfa2c491cc8 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-2c212224-fe0e-4b64-92cf-825d0126a4cb-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:25 devstack sudo[113526]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.264s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Deleted volume successfully. Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-e4677843-6271-4a36-8578-ccd770e29f3a tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-0070d847-10ad-46b2-9a7b-a83b7f3bb61d-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "cinder-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "cinder-quobyte-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" acquired by "delete_volume" :: waited 0.021s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdde2544-c45f-42e6-82fa-84f7f7c271d3]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:26 devstack sudo[113531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd Aug 26 12:18:26 devstack sudo[113531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-8b029963-6b22-48bc-b62c-0c98bff38f1e-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-8b029963-6b22-48bc-b62c-0c98bff38f1e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:26 devstack sudo[113531]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" returned: 0 in 0.384s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:26 devstack sudo[113537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd Aug 26 12:18:26 devstack sudo[113537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-8b029963-6b22-48bc-b62c-0c98bff38f1e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-8b029963-6b22-48bc-b62c-0c98bff38f1e" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcd4130-48f9-446c-949e-f210745eff8d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:26 devstack sudo[113539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e Aug 26 12:18:26 devstack sudo[113539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:26 devstack sudo[113537]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" returned: 0 in 0.252s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-quobyte-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd" released by "delete_volume" :: held 0.675s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Created reservations ['20fc2f17-e5b4-4e53-b447-63c3a6893e79', '0acb2961-01af-42ac-879b-14d4e6602c63', 'bec73789-ec73-4fe4-a5f1-b0ffaf9e5405', 'b6bda22d-26dc-414b-be35-f69964d99aa4'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:26 devstack sudo[113544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:26 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:26 devstack sudo[113539]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e" returned: 0 in 0.376s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:26 devstack sudo[113547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e Aug 26 12:18:26 devstack sudo[113547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:27 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.265s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Deleted volume successfully. Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-608905bc-6458-42cb-b68b-c6936948092c tempest-SnapshotDependencyTests-577021388 None] Lock "cinder-1aa8e4fb-60fd-438c-b445-e0ba6de3c2bd-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:27 devstack sudo[113547]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-8b029963-6b22-48bc-b62c-0c98bff38f1e" returned: 0 in 0.278s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-8b029963-6b22-48bc-b62c-0c98bff38f1e" released by "delete_volume" :: held 0.712s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Created reservations ['ffd8b004-dee5-4f6c-9746-f78556a6af4b', '840d1bea-49be-4074-be1b-f6db600baa47', '6e3f5934-9004-4778-b7e5-83f9b1da172c', '6a766bfd-9184-4db6-9b3f-e8ad3020ba3f'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:27 devstack sudo[113551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:27 devstack sudo[113551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:27 devstack sudo[113551]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.248s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Deleted volume successfully. Aug 26 12:18:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-aa797de0-5e5d-482e-85ea-401675d87463 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-8b029963-6b22-48bc-b62c-0c98bff38f1e-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (c1047dae-bef7-43a7-b042-71635a67de7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8d6506-80a7-4bff-b3d0-d8a2b67be700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8d6506-80a7-4bff-b3d0-d8a2b67be700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231973324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8c1095-4d0e-43b7-8237-77487a213e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:28Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da7b277-d831-43cf-a691-ada6c2efa71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da7b277-d831-43cf-a691-ada6c2efa71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3fd772-44f3-4364-82ac-351ee41d1ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3fd772-44f3-4364-82ac-351ee41d1ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a8c1095-4d0e-43b7-8237-77487a213e29', 'volume_name': 'volume-0a8c1095-4d0e-43b7-8237-77487a213e29', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f61b0ad-ed74-4c88-bf9e-82516982b7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f61b0ad-ed74-4c88-bf9e-82516982b7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7656cbe4-134f-411b-88f3-319f5bd7d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:28 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Volume 0a8c1095-4d0e-43b7-8237-77487a213e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a8c1095-4d0e-43b7-8237-77487a213e29', 'volume_size': 1} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231973324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8c1095-4d0e-43b7-8237-77487a213e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:28Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Creating volume 0a8c1095-4d0e-43b7-8237-77487a213e29 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:18:28 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:28 devstack sudo[113555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 1073741824 Aug 26 12:18:28 devstack sudo[113555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:28 devstack sudo[113555]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 1073741824" returned: 0 in 0.427s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:28 devstack sudo[113562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 Aug 26 12:18:28 devstack sudo[113562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:28 devstack sudo[113562]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29" returned: 0 in 0.288s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7656cbe4-134f-411b-88f3-319f5bd7d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a8c1095-4d0e-43b7-8237-77487a213e29', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6023b0-162e-48b9-811f-7add89c40a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:28 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Volume volume-0a8c1095-4d0e-43b7-8237-77487a213e29 (0a8c1095-4d0e-43b7-8237-77487a213e29): created successfully Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6023b0-162e-48b9-811f-7add89c40a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:28 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (c1047dae-bef7-43a7-b042-71635a67de7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:28 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-74ec6d12-f29d-407b-924b-04efcc2558ba tempest-ProjectMemberTests-1123874349 None] Created volume successfully. Aug 26 12:18:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Creating offline snapshot 0d196000-b997-435d-ba54-5d1649115a26 of volume 0a8c1095-4d0e-43b7-8237-77487a213e29 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:18:29 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0e63cb-de05-4bf6-b9b4-758b90ed0459]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:29 devstack sudo[113565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 Aug 26 12:18:29 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:29 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29" returned: 0 in 0.376s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:29 devstack sudo[113570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 1G Aug 26 12:18:29 devstack sudo[113570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:30 devstack sudo[113570]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 1G" returned: 0 in 0.425s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a8c1095-4d0e-43b7-8237-77487a213e29 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:30 devstack sudo[113575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a8c1095-4d0e-43b7-8237-77487a213e29 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 Aug 26 12:18:30 devstack sudo[113575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:30 devstack sudo[113575]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a8c1095-4d0e-43b7-8237-77487a213e29 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26" returned: 0 in 0.283s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:30 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 is being set with open permissions: ugo+rw Aug 26 12:18:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:30 devstack sudo[113580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 Aug 26 12:18:30 devstack sudo[113580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:30 devstack sudo[113580]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26" returned: 0 in 0.293s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:30 devstack sudo[113583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.info Aug 26 12:18:30 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:30 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.info" returned: 0 in 0.270s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:30 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.info is being set with open permissions: ugo+rw Aug 26 12:18:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:30 devstack sudo[113586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.info Aug 26 12:18:30 devstack sudo[113586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:31 devstack sudo[113586]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.info" returned: 0 in 0.253s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:31 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ed04d3a1-6e1e-49c0-ade9-4347fadbc017 tempest-ProjectMemberTests-1123874349 None] Create snapshot completed successfully Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-0d196000-b997-435d-ba54-5d1649115a26-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Lock "cinder-0d196000-b997-435d-ba54-5d1649115a26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-0a8c1095-4d0e-43b7-8237-77487a213e29" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-0a8c1095-4d0e-43b7-8237-77487a213e29" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-0d196000-b997-435d-ba54-5d1649115a26" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-0d196000-b997-435d-ba54-5d1649115a26" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Deleting offline snapshot 0d196000-b997-435d-ba54-5d1649115a26 of volume 0a8c1095-4d0e-43b7-8237-77487a213e29 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] snapshot_file for this snap is: volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[633eff14-d08c-45fb-a7fd-5a886bee04f9]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:32 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 Aug 26 12:18:32 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:32 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26" returned: 0 in 0.385s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a8c1095-4d0e-43b7-8237-77487a213e29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3d2faf-ed8c-469f-85d9-e0eceec2d63b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:32 devstack sudo[113596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 Aug 26 12:18:32 devstack sudo[113596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:33 devstack sudo[113596]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29" returned: 0 in 0.366s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:33 devstack sudo[113601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 Aug 26 12:18:33 devstack sudo[113601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:33 devstack sudo[113601]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26" returned: 0 in 0.339s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:33 devstack sudo[113607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26 Aug 26 12:18:33 devstack sudo[113607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:33 devstack sudo[113607]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29.0d196000-b997-435d-ba54-5d1649115a26" returned: 0 in 0.279s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-0d196000-b997-435d-ba54-5d1649115a26" released by "_delete_snapshot" :: held 1.472s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:33 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-0a8c1095-4d0e-43b7-8237-77487a213e29" released by "delete_snapshot" :: held 1.499s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:33 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Created reservations ['ee6a0d79-2d64-4dc3-bf02-eba1b94509d1', 'd0ef223c-4713-442f-9a30-55b66a7ea0ad', '2c94b761-91a9-424b-92e8-c87768140db9', '6d31b595-3b58-43b4-9a46-dabb9d9aaf8d'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Delete snapshot completed successfully. Aug 26 12:18:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-cae8c41b-addf-4879-9b0c-70d53c463bde tempest-ProjectMemberTests-1123874349 None] Lock "cinder-0d196000-b997-435d-ba54-5d1649115a26-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-0a8c1095-4d0e-43b7-8237-77487a213e29-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-0a8c1095-4d0e-43b7-8237-77487a213e29-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:34 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=112,cinder:UPDATE=130,cinder:INSERT=35,cinder:DELETE=10 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:18:34 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:INSERT=39,cinder:UPDATE=140,cinder:SELECT=104,cinder:DELETE=13 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:18:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-0a8c1095-4d0e-43b7-8237-77487a213e29" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-0a8c1095-4d0e-43b7-8237-77487a213e29" acquired by "delete_volume" :: waited 0.026s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:34 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2a3215-96ba-4652-a317-f672857950a8]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:34 devstack sudo[113646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 Aug 26 12:18:34 devstack sudo[113646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:35 devstack sudo[113646]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29" returned: 0 in 0.394s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:35 devstack sudo[113651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29 Aug 26 12:18:35 devstack sudo[113651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:35 devstack sudo[113651]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-0a8c1095-4d0e-43b7-8237-77487a213e29" returned: 0 in 0.254s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-0a8c1095-4d0e-43b7-8237-77487a213e29" released by "delete_volume" :: held 0.729s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Created reservations ['ff22db37-6267-41a4-9c29-7542061cc3ae', 'adbe659c-751f-4e43-92ea-5da1570af44e', '02b57ada-5075-4eba-b966-4c64c171a874', '8565af51-5ebc-4273-ae06-7489ad26ec99'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:35 devstack sudo[113654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:35 devstack sudo[113654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:35 devstack sudo[113654]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.300s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:35 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Deleted volume successfully. Aug 26 12:18:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c440e873-5a48-43e7-988f-c8030893efd9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-0a8c1095-4d0e-43b7-8237-77487a213e29-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (44a358b9-c07f-4ce0-a8e1-9b8ec751b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34543fc-9bd2-4020-9f98-f699eec86a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34543fc-9bd2-4020-9f98-f699eec86a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-766763990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05771d99-a11e-4a82-bdf6-a5e0702ff037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:36Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306daf16-8e26-43ab-8653-77c736c955a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306daf16-8e26-43ab-8653-77c736c955a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613a1857-d6aa-4b36-9380-8dbccda9e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613a1857-d6aa-4b36-9380-8dbccda9e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05771d99-a11e-4a82-bdf6-a5e0702ff037', 'volume_name': 'volume-05771d99-a11e-4a82-bdf6-a5e0702ff037', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171aae78-e713-4737-b3b0-f3a73e348156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171aae78-e713-4737-b3b0-f3a73e348156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2c2574-2564-4bf7-b4e8-105a1f2a121c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:36 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Volume 05771d99-a11e-4a82-bdf6-a5e0702ff037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05771d99-a11e-4a82-bdf6-a5e0702ff037', 'volume_size': 1} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-766763990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05771d99-a11e-4a82-bdf6-a5e0702ff037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:36Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Creating volume 05771d99-a11e-4a82-bdf6-a5e0702ff037 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:18:36 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:36 devstack sudo[113659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 1073741824 Aug 26 12:18:36 devstack sudo[113659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:36 devstack sudo[113659]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 1073741824" returned: 0 in 0.480s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:36 devstack sudo[113665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 Aug 26 12:18:36 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:37 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037" returned: 0 in 0.252s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:37 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:18:37 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2c2574-2564-4bf7-b4e8-105a1f2a121c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05771d99-a11e-4a82-bdf6-a5e0702ff037', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8f3a7f-0a7b-4bf4-b5b2-b2fbf63b65b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:37 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Volume volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 (05771d99-a11e-4a82-bdf6-a5e0702ff037): created successfully Aug 26 12:18:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8f3a7f-0a7b-4bf4-b5b2-b2fbf63b65b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:37 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (44a358b9-c07f-4ce0-a8e1-9b8ec751b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:37 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-aff6f413-2e8c-4159-bdb0-984d3cd91835 tempest-ProjectMemberTests-1123874349 None] Created volume successfully. Aug 26 12:18:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:38 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Creating offline snapshot f3fb12a7-3b06-4faf-8b6d-c39013962188 of volume 05771d99-a11e-4a82-bdf6-a5e0702ff037 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:18:38 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d72909-e27d-489e-ad6b-86866e31f30e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:38 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 Aug 26 12:18:38 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:38 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037" returned: 0 in 0.352s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:38 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:38 devstack sudo[113673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 1G Aug 26 12:18:38 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:39 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 1G" returned: 0 in 0.386s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:39 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 Aug 26 12:18:39 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:39 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188" returned: 0 in 0.286s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:39 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 is being set with open permissions: ugo+rw Aug 26 12:18:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:39 devstack sudo[113689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 Aug 26 12:18:39 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:39 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188" returned: 0 in 0.236s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:39 devstack sudo[113692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.info Aug 26 12:18:39 devstack sudo[113692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:39 devstack sudo[113692]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.info" returned: 0 in 0.247s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:39 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.info is being set with open permissions: ugo+rw Aug 26 12:18:39 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:39 devstack sudo[113695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.info Aug 26 12:18:39 devstack sudo[113695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:40 devstack sudo[113695]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.info" returned: 0 in 0.237s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:40 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-42e80e5d-f522-480a-b558-0e66366b2d39 tempest-ProjectMemberTests-1123874349 None] Create snapshot completed successfully Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-f3fb12a7-3b06-4faf-8b6d-c39013962188-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-f3fb12a7-3b06-4faf-8b6d-c39013962188-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-05771d99-a11e-4a82-bdf6-a5e0702ff037" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-05771d99-a11e-4a82-bdf6-a5e0702ff037" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-f3fb12a7-3b06-4faf-8b6d-c39013962188" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-f3fb12a7-3b06-4faf-8b6d-c39013962188" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Deleting offline snapshot f3fb12a7-3b06-4faf-8b6d-c39013962188 of volume 05771d99-a11e-4a82-bdf6-a5e0702ff037 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] snapshot_file for this snap is: volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0c954a-9e89-4ff2-8d6f-bb4f2711666a]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:40 devstack sudo[113698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 Aug 26 12:18:40 devstack sudo[113698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:40 devstack sudo[113698]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188" returned: 0 in 0.348s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05771d99-a11e-4a82-bdf6-a5e0702ff037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa69e32b-9984-4bc3-b748-790a2f14a4f2]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:40 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:41 devstack sudo[113703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 Aug 26 12:18:41 devstack sudo[113703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:41 devstack sudo[113703]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037" returned: 0 in 0.349s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:41 devstack sudo[113709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 Aug 26 12:18:41 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:41 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188" returned: 0 in 0.332s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:41 devstack sudo[113714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188 Aug 26 12:18:41 devstack sudo[113714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:41 devstack sudo[113714]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:41 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037.f3fb12a7-3b06-4faf-8b6d-c39013962188" returned: 0 in 0.241s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-f3fb12a7-3b06-4faf-8b6d-c39013962188" released by "_delete_snapshot" :: held 1.358s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:41 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-05771d99-a11e-4a82-bdf6-a5e0702ff037" released by "delete_snapshot" :: held 1.380s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:41 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Created reservations ['90452c15-43cc-4fd2-bb45-2e3189e3f3a4', '1d22b49b-10ea-400d-b3ff-cdd4d44b3556', 'f181bdc2-6058-4d5d-876a-cec75baa21f6', '42d1eea3-0172-4515-a5ee-9a2013c764b0'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:42 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Delete snapshot completed successfully. Aug 26 12:18:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-062604dc-333d-4915-b048-f9e4422ebf39 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-f3fb12a7-3b06-4faf-8b6d-c39013962188-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-05771d99-a11e-4a82-bdf6-a5e0702ff037-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-05771d99-a11e-4a82-bdf6-a5e0702ff037-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-05771d99-a11e-4a82-bdf6-a5e0702ff037" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:42 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-05771d99-a11e-4a82-bdf6-a5e0702ff037" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:42 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daec600-5055-424c-bb01-1eebab1d426d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:42 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:42 devstack sudo[113717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 Aug 26 12:18:42 devstack sudo[113717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:43 devstack sudo[113717]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037" returned: 0 in 0.349s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:43 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037 Aug 26 12:18:43 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:43 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-05771d99-a11e-4a82-bdf6-a5e0702ff037" returned: 0 in 0.243s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-05771d99-a11e-4a82-bdf6-a5e0702ff037" released by "delete_volume" :: held 0.645s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Created reservations ['46beaa8a-2fc2-49c6-b7b8-c927821418da', 'd89bf5f8-6d56-4b06-9a01-891d056a6070', '9817a792-e616-4892-8f53-bbbc308ae4cf', '9b8b9a4c-4395-4252-8c0d-7125095cc070'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:43 devstack sudo[113727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:43 devstack sudo[113727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:43 devstack sudo[113727]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.246s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:43 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Deleted volume successfully. Aug 26 12:18:43 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c40223f2-6d59-43af-86c7-837d2e9fea0b tempest-ProjectMemberTests-1123874349 None] Lock "cinder-05771d99-a11e-4a82-bdf6-a5e0702ff037-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (83b18545-056d-4638-a8a0-8484d4c5e2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f07303-c026-4566-984d-95a900b8e6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f07303-c026-4566-984d-95a900b8e6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355501242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377eb11b-519d-48e8-84b7-48c39f9571ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:44Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d71c90c-2a93-4e76-8cfc-504bd2db835f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d71c90c-2a93-4e76-8cfc-504bd2db835f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9820efab-05e4-493a-9cb2-62c75906b4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9820efab-05e4-493a-9cb2-62c75906b4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '377eb11b-519d-48e8-84b7-48c39f9571ef', 'volume_name': 'volume-377eb11b-519d-48e8-84b7-48c39f9571ef', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e22a716-c78a-4de0-841d-049f6e6588df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e22a716-c78a-4de0-841d-049f6e6588df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e9dadf-a83a-42c8-8a56-960c0f771d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:44 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Volume 377eb11b-519d-48e8-84b7-48c39f9571ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-377eb11b-519d-48e8-84b7-48c39f9571ef', 'volume_size': 1} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355501242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377eb11b-519d-48e8-84b7-48c39f9571ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:44Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Creating volume 377eb11b-519d-48e8-84b7-48c39f9571ef {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:18:44 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:44 devstack sudo[113730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef 1073741824 Aug 26 12:18:44 devstack sudo[113730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:44 devstack sudo[113730]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef 1073741824" returned: 0 in 0.421s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:44 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:44 devstack sudo[113736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef Aug 26 12:18:44 devstack sudo[113736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:45 devstack sudo[113736]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef" returned: 0 in 0.240s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e9dadf-a83a-42c8-8a56-960c0f771d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377eb11b-519d-48e8-84b7-48c39f9571ef', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b23537-d32e-4f6b-a295-83ffac293db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:45 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Volume volume-377eb11b-519d-48e8-84b7-48c39f9571ef (377eb11b-519d-48e8-84b7-48c39f9571ef): created successfully Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b23537-d32e-4f6b-a295-83ffac293db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (83b18545-056d-4638-a8a0-8484d4c5e2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:45 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-7a5dadbd-86b8-4be6-b730-84a5ee039cbd tempest-ProjectMemberTests-1123874349 None] Created volume successfully. Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Creating offline snapshot 6b7b2953-6360-4b1d-b121-a78d8f530ca2 of volume 377eb11b-519d-48e8-84b7-48c39f9571ef {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db4b6a-8c54-4ff8-b7ff-89d6218e7eb4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:45 devstack sudo[113739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef Aug 26 12:18:45 devstack sudo[113739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:45 devstack sudo[113739]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef" returned: 0 in 0.360s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:45 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:45 devstack sudo[113744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 1G Aug 26 12:18:45 devstack sudo[113744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:46 devstack sudo[113744]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 1G" returned: 0 in 0.380s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-377eb11b-519d-48e8-84b7-48c39f9571ef -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:46 devstack sudo[113750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-377eb11b-519d-48e8-84b7-48c39f9571ef -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 Aug 26 12:18:46 devstack sudo[113750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:46 devstack sudo[113750]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-377eb11b-519d-48e8-84b7-48c39f9571ef -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2" returned: 0 in 0.285s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:46 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 is being set with open permissions: ugo+rw Aug 26 12:18:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:46 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 Aug 26 12:18:46 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:46 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2" returned: 0 in 0.242s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:46 devstack sudo[113758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.info Aug 26 12:18:46 devstack sudo[113758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:46 devstack sudo[113758]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.info" returned: 0 in 0.242s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:46 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.info is being set with open permissions: ugo+rw Aug 26 12:18:46 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:46 devstack sudo[113761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.info Aug 26 12:18:46 devstack sudo[113761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:47 devstack sudo[113761]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.info" returned: 0 in 0.235s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:47 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-896ad65a-e74d-4dd0-94e0-d8003ef52e11 tempest-ProjectMemberTests-1123874349 None] Create snapshot completed successfully Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-6b7b2953-6360-4b1d-b121-a78d8f530ca2-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-6b7b2953-6360-4b1d-b121-a78d8f530ca2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-377eb11b-519d-48e8-84b7-48c39f9571ef" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-377eb11b-519d-48e8-84b7-48c39f9571ef" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-6b7b2953-6360-4b1d-b121-a78d8f530ca2" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-6b7b2953-6360-4b1d-b121-a78d8f530ca2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Deleting offline snapshot 6b7b2953-6360-4b1d-b121-a78d8f530ca2 of volume 377eb11b-519d-48e8-84b7-48c39f9571ef {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] snapshot_file for this snap is: volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eda0216-cd06-4cdc-a517-871b24f4edf6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:47 devstack sudo[113764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 Aug 26 12:18:47 devstack sudo[113764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:47 devstack sudo[113764]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2" returned: 0 in 0.343s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-377eb11b-519d-48e8-84b7-48c39f9571ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d740e568-01e5-4868-9b64-9b6c4aba54d5]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:47 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:48 devstack sudo[113769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef Aug 26 12:18:48 devstack sudo[113769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:48 devstack sudo[113769]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef" returned: 0 in 0.345s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:48 devstack sudo[113774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 Aug 26 12:18:48 devstack sudo[113774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:48 devstack sudo[113774]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2" returned: 0 in 0.323s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:48 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2 Aug 26 12:18:48 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:48 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:48 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef.6b7b2953-6360-4b1d-b121-a78d8f530ca2" returned: 0 in 0.236s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-6b7b2953-6360-4b1d-b121-a78d8f530ca2" released by "_delete_snapshot" :: held 1.334s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:48 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-377eb11b-519d-48e8-84b7-48c39f9571ef" released by "delete_snapshot" :: held 1.355s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:48 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Created reservations ['f59cc7ee-f283-4797-ae16-f3e81807891a', 'afff2c3b-837b-4e4d-8e63-bd2b5cf457e0', 'f6865881-7662-43ba-af4c-6408a4e1fb4f', '89de9f53-34db-4a12-8989-c99fccbbeb7b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:49 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Delete snapshot completed successfully. Aug 26 12:18:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e7c4994-e0b9-4a96-ba1e-a13d5404bf73 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-6b7b2953-6360-4b1d-b121-a78d8f530ca2-delete_snapshot" released by "delete_snapshot" :: held 1.481s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-377eb11b-519d-48e8-84b7-48c39f9571ef-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-377eb11b-519d-48e8-84b7-48c39f9571ef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-377eb11b-519d-48e8-84b7-48c39f9571ef" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:49 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-377eb11b-519d-48e8-84b7-48c39f9571ef" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:49 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[921e5fd6-a64a-4a74-a7f3-16d53512917f]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:49 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:49 devstack sudo[113782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef Aug 26 12:18:49 devstack sudo[113782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:50 devstack sudo[113782]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef" returned: 0 in 0.344s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:50 devstack sudo[113787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef Aug 26 12:18:50 devstack sudo[113787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:50 devstack sudo[113787]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-377eb11b-519d-48e8-84b7-48c39f9571ef" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-377eb11b-519d-48e8-84b7-48c39f9571ef" released by "delete_volume" :: held 0.634s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Created reservations ['9f9b7d8f-adde-4a19-829c-42a16a245ca2', '04dbeb2e-3d5c-48c8-9848-299a7088182d', 'feaa79e1-0f34-4a54-b11d-fe3add4e695b', 'd56b7522-5cfc-4685-b28f-3c1b50a24669'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:50 devstack sudo[113790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:50 devstack sudo[113790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:50 devstack sudo[113790]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.239s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:50 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Deleted volume successfully. Aug 26 12:18:50 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d4548a88-9764-48b4-80b3-291fcdf9c8cf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-377eb11b-519d-48e8-84b7-48c39f9571ef-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (bd9bfbcd-7e60-4517-a936-2173510582d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17734307-18d4-48a0-87d1-5e097d85013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17734307-18d4-48a0-87d1-5e097d85013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052735228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990f1e59-56b3-4e38-bf81-4b7a23af3cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:51Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9813f6b9-a6d3-455a-8b09-5f0e584700c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9813f6b9-a6d3-455a-8b09-5f0e584700c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e289fcf-973d-4ea8-a240-f6f1d22b3a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e289fcf-973d-4ea8-a240-f6f1d22b3a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990f1e59-56b3-4e38-bf81-4b7a23af3cf5', 'volume_name': 'volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0aeaa40-7e34-4778-b66c-fe4d6fd5110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0aeaa40-7e34-4778-b66c-fe4d6fd5110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819c6da3-3719-4755-b9fc-95771fe3ba94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:51 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Volume 990f1e59-56b3-4e38-bf81-4b7a23af3cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5', 'volume_size': 1} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052735228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990f1e59-56b3-4e38-bf81-4b7a23af3cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fac7c6e9c447a89af218a88439337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:18:51Z,use_quota=True,user_id='2c1d12bd53a24034b75b0ceb1c236688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Creating volume 990f1e59-56b3-4e38-bf81-4b7a23af3cf5 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:18:51 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:51 devstack sudo[113793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 1073741824 Aug 26 12:18:51 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:51 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 1073741824" returned: 0 in 0.407s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:51 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:51 devstack sudo[113798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 Aug 26 12:18:51 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:52 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" returned: 0 in 0.235s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819c6da3-3719-4755-b9fc-95771fe3ba94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0969b3-071c-4885-9410-b26f2b9a43a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:18:52 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Volume volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 (990f1e59-56b3-4e38-bf81-4b7a23af3cf5): created successfully Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0969b3-071c-4885-9410-b26f2b9a43a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Flow 'volume_create_manager' (bd9bfbcd-7e60-4517-a936-2173510582d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:18:52 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b703f1e6-9416-429e-ab8b-dd9d8105ba7a tempest-ProjectMemberTests-1123874349 None] Created volume successfully. Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Creating offline snapshot 69c44c46-cd47-42e7-b6f8-a0cb8f208c70 of volume 990f1e59-56b3-4e38-bf81-4b7a23af3cf5 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[03813c85-a247-4b18-82fd-fa0351624d77]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:52 devstack sudo[113801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 Aug 26 12:18:52 devstack sudo[113801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:52 devstack sudo[113801]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:52 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:52 devstack sudo[113806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 1G Aug 26 12:18:52 devstack sudo[113806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:53 devstack sudo[113806]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 1G" returned: 0 in 0.383s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:53 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 Aug 26 12:18:53 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:53 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70" returned: 0 in 0.286s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:53 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 is being set with open permissions: ugo+rw Aug 26 12:18:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:53 devstack sudo[113816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 Aug 26 12:18:53 devstack sudo[113816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:53 devstack sudo[113816]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:53 devstack sudo[113819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.info Aug 26 12:18:53 devstack sudo[113819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:53 devstack sudo[113819]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.info" returned: 0 in 0.239s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:53 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.info is being set with open permissions: ugo+rw Aug 26 12:18:53 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:53 devstack sudo[113822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.info Aug 26 12:18:53 devstack sudo[113822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:54 devstack sudo[113822]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.info" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:54 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-cd6d09e9-64e0-4f9d-877d-e0b8c9adcff5 tempest-ProjectMemberTests-1123874349 None] Create snapshot completed successfully Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-69c44c46-cd47-42e7-b6f8-a0cb8f208c70-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-69c44c46-cd47-42e7-b6f8-a0cb8f208c70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-69c44c46-cd47-42e7-b6f8-a0cb8f208c70" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-69c44c46-cd47-42e7-b6f8-a0cb8f208c70" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Deleting offline snapshot 69c44c46-cd47-42e7-b6f8-a0cb8f208c70 of volume 990f1e59-56b3-4e38-bf81-4b7a23af3cf5 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] snapshot_file for this snap is: volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7873ef2-d499-4e32-8777-c94e5bab455b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:54 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:54 devstack sudo[113825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 Aug 26 12:18:54 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:55 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70" returned: 0 in 0.347s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:55 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:18:55 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b64a09-e6b0-45a0-b6fc-d4bc6bb7df81]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:55 devstack sudo[113830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 Aug 26 12:18:55 devstack sudo[113830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:55 devstack sudo[113830]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" returned: 0 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:55 devstack sudo[113835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 Aug 26 12:18:55 devstack sudo[113835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:55 devstack sudo[113835]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70" returned: 0 in 0.327s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:55 devstack sudo[113840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70 Aug 26 12:18:55 devstack sudo[113840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:55 devstack sudo[113840]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:55 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5.69c44c46-cd47-42e7-b6f8-a0cb8f208c70" returned: 0 in 0.234s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-69c44c46-cd47-42e7-b6f8-a0cb8f208c70" released by "_delete_snapshot" :: held 1.339s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" released by "delete_snapshot" :: held 1.358s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Created reservations ['5c66aeaa-98bf-4867-a9df-eb27079371c8', '30352b12-f1fe-48ef-a702-ceebc1f22a60', '6f29b655-83c3-4499-8e22-070a145bc73d', '3a50f339-5a66-4e68-bee2-cec9205d47bb'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:56 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Delete snapshot completed successfully. Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-ecadfdab-fdfa-4fc6-ab5f-ec7adaa56fcf tempest-ProjectMemberTests-1123874349 None] Lock "cinder-69c44c46-cd47-42e7-b6f8-a0cb8f208c70-delete_snapshot" released by "delete_snapshot" :: held 1.475s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-990f1e59-56b3-4e38-bf81-4b7a23af3cf5-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-990f1e59-56b3-4e38-bf81-4b7a23af3cf5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "cinder-quobyte-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" acquired by "delete_volume" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bfd7a7-485c-42ce-b23e-7f048674ac49]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:18:56 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:56 devstack sudo[113844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 Aug 26 12:18:56 devstack sudo[113844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:57 devstack sudo[113844]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:57 devstack sudo[113849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5 Aug 26 12:18:57 devstack sudo[113849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:57 devstack sudo[113849]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" returned: 0 in 0.242s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-quobyte-990f1e59-56b3-4e38-bf81-4b7a23af3cf5" released by "delete_volume" :: held 0.647s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Created reservations ['56716896-ed6b-4843-a94f-44de84d79e02', 'f2253021-c4e0-4c0d-8f95-dbcf418a3d08', 'ba5af8de-cf97-45a5-8f37-1e2a833f96e2', '38d66edb-47d4-45c4-92f5-1b30043b7bd6'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:18:57 devstack sudo[113852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:18:57 devstack sudo[113852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:18:57 devstack sudo[113852]: pam_unix(sudo:session): session closed for user root Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.241s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:18:57 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Deleted volume successfully. Aug 26 12:18:57 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-d234d6d2-a5f1-4766-bcde-73a7a7b855a9 tempest-ProjectMemberTests-1123874349 None] Lock "cinder-990f1e59-56b3-4e38-bf81-4b7a23af3cf5-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (8fc9a189-880c-48c3-a336-10991c5cac17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106ec194-4c6c-4072-8961-f50e4da9240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106ec194-4c6c-4072-8961-f50e4da9240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1768522194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81aabbe3-26b9-45f9-990a-e09c7f4d81bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:01Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3837f25-84d3-4c60-b038-31c43fc70c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3837f25-84d3-4c60-b038-31c43fc70c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328453c7-cae5-4ab0-b7e5-06cc5c60d972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328453c7-cae5-4ab0-b7e5-06cc5c60d972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81aabbe3-26b9-45f9-990a-e09c7f4d81bf', 'volume_name': 'volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc62f1f-3b0f-4176-be8e-200593932dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc62f1f-3b0f-4176-be8e-200593932dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514bc62a-dad5-41ad-b0ee-363f688e2fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:01 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Volume 81aabbe3-26b9-45f9-990a-e09c7f4d81bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf', 'volume_size': 1} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1768522194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81aabbe3-26b9-45f9-990a-e09c7f4d81bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:01Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Creating volume 81aabbe3-26b9-45f9-990a-e09c7f4d81bf {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:19:01 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:01 devstack sudo[113855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf 1073741824 Aug 26 12:19:01 devstack sudo[113855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:01 devstack sudo[113855]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf 1073741824" returned: 0 in 0.417s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:01 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:01 devstack sudo[113860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf Aug 26 12:19:01 devstack sudo[113860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:02 devstack sudo[113860]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" returned: 0 in 0.245s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514bc62a-dad5-41ad-b0ee-363f688e2fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f56c41e-6ff5-469c-a04d-aaac07f8e304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:02 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Volume volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf (81aabbe3-26b9-45f9-990a-e09c7f4d81bf): created successfully Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f56c41e-6ff5-469c-a04d-aaac07f8e304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (8fc9a189-880c-48c3-a336-10991c5cac17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:02 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-393b614c-66d4-4559-b573-081834e580a5 tempest-ProjectReaderTests-551654951 None] Created volume successfully. Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Creating offline snapshot 0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 of volume 81aabbe3-26b9-45f9-990a-e09c7f4d81bf {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcfc380-8845-4a1d-9a79-2a315884acaf]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:02 devstack sudo[113863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf Aug 26 12:19:02 devstack sudo[113863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:02 devstack sudo[113863]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" returned: 0 in 0.344s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:02 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:02 devstack sudo[113868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 1G Aug 26 12:19:02 devstack sudo[113868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:03 devstack sudo[113868]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 1G" returned: 0 in 0.379s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:03 devstack sudo[113873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 Aug 26 12:19:03 devstack sudo[113873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:03 devstack sudo[113873]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165" returned: 0 in 0.283s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:03 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 is being set with open permissions: ugo+rw Aug 26 12:19:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:03 devstack sudo[113878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 Aug 26 12:19:03 devstack sudo[113878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:03 devstack sudo[113878]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165" returned: 0 in 0.232s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:03 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:03 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.info Aug 26 12:19:03 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:04 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.info" returned: 0 in 0.239s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:04 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.info is being set with open permissions: ugo+rw Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:04 devstack sudo[113884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.info Aug 26 12:19:04 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:04 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.info" returned: 0 in 0.234s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.788s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:04 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-619af3a0-592b-4276-a609-cc682490f4e0 tempest-ProjectReaderTests-551654951 None] Create snapshot completed successfully Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Lock "cinder-0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Deleting offline snapshot 0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 of volume 81aabbe3-26b9-45f9-990a-e09c7f4d81bf {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] snapshot_file for this snap is: volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fdd9fe-77de-49ca-9fd6-52a216347a03]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:04 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:04 devstack sudo[113887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 Aug 26 12:19:04 devstack sudo[113887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:05 devstack sudo[113887]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165" returned: 0 in 0.344s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:05 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:19:05 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f48abd-fec9-4cac-b3c1-90393f365040]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:05 devstack sudo[113892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf Aug 26 12:19:05 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:05 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" returned: 0 in 0.341s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:05 devstack sudo[113897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 Aug 26 12:19:05 devstack sudo[113897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:05 devstack sudo[113897]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:05 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:05 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165 Aug 26 12:19:05 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:06 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:06 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf.0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165" returned: 0 in 0.253s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165" released by "_delete_snapshot" :: held 1.380s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" released by "delete_snapshot" :: held 1.403s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:06 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Created reservations ['f3ab8325-5c36-4e21-b1e6-e374829fa32a', '5fa1f893-4992-49de-b181-f5c81ae8e56e', '62b8b0e9-9edd-4772-ac0f-1dc8e3d78010', 'c4bbb74b-7fb7-4091-8e3c-d2a8a996feb9'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:06 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Delete snapshot completed successfully. Aug 26 12:19:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a0f0b5a4-45ff-4b99-bb63-639c5486acb6 tempest-ProjectReaderTests-551654951 None] Lock "cinder-0ab5dcd4-7cce-4b23-b4dd-1f1cb43d7165-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-81aabbe3-26b9-45f9-990a-e09c7f4d81bf-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Lock "cinder-81aabbe3-26b9-45f9-990a-e09c7f4d81bf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:06 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" acquired by "delete_volume" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e23ef2-f556-4aac-bd06-94376cc14621]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:07 devstack sudo[113907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf Aug 26 12:19:07 devstack sudo[113907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:07 devstack sudo[113907]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" returned: 0 in 0.350s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:07 devstack sudo[113912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf Aug 26 12:19:07 devstack sudo[113912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:07 devstack sudo[113912]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" returned: 0 in 0.239s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-81aabbe3-26b9-45f9-990a-e09c7f4d81bf" released by "delete_volume" :: held 0.643s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Created reservations ['e2934da3-a337-4517-9970-dfa8ce52d065', 'd921681c-f14c-4a16-9549-885bb3a5be2e', '9cec1458-dafa-477c-8ab3-acd734fdc490', 'fc863ae5-1f20-4202-82e5-6eed959de36b'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:07 devstack sudo[113915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:19:07 devstack sudo[113915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:07 devstack sudo[113915]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.237s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:07 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:19:07 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Deleted volume successfully. Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-889aed0e-4880-4ddf-82c0-e6e6a38be4fd tempest-ProjectReaderTests-551654951 None] Lock "cinder-81aabbe3-26b9-45f9-990a-e09c7f4d81bf-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (3cf6e1c5-c10b-481a-aaef-384062e11043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94204392-3415-42e6-926f-1482a9003a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94204392-3415-42e6-926f-1482a9003a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384347110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64aa449-8ad9-4f68-afc1-3a485b67de82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:08Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97cbc37-c9de-4ab6-b24d-ee7f089cb24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97cbc37-c9de-4ab6-b24d-ee7f089cb24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5e9e5e-c1cd-459b-986c-e41fcd182014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5e9e5e-c1cd-459b-986c-e41fcd182014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64aa449-8ad9-4f68-afc1-3a485b67de82', 'volume_name': 'volume-d64aa449-8ad9-4f68-afc1-3a485b67de82', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5626bafa-f5e9-46b3-83a8-e1e235905b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5626bafa-f5e9-46b3-83a8-e1e235905b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708d2f1a-c09e-4133-8c85-bdefd6b14758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:08 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Volume d64aa449-8ad9-4f68-afc1-3a485b67de82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64aa449-8ad9-4f68-afc1-3a485b67de82', 'volume_size': 1} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384347110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64aa449-8ad9-4f68-afc1-3a485b67de82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:08Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Creating volume d64aa449-8ad9-4f68-afc1-3a485b67de82 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:19:08 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:19:08 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:08 devstack sudo[113918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 1073741824 Aug 26 12:19:08 devstack sudo[113918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:09 devstack sudo[113918]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 1073741824" returned: 0 in 0.410s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:09 devstack sudo[113924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 Aug 26 12:19:09 devstack sudo[113924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:09 devstack sudo[113924]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82" returned: 0 in 0.246s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708d2f1a-c09e-4133-8c85-bdefd6b14758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64aa449-8ad9-4f68-afc1-3a485b67de82', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0c38bb-015d-4cb6-b127-9f5d9a0cd6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:09 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Volume volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 (d64aa449-8ad9-4f68-afc1-3a485b67de82): created successfully Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0c38bb-015d-4cb6-b127-9f5d9a0cd6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (3cf6e1c5-c10b-481a-aaef-384062e11043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:09 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-acd78bd4-ba57-4e9b-8f34-379efb58170d tempest-ProjectReaderTests-551654951 None] Created volume successfully. Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Creating offline snapshot 40bf584b-d83e-4403-9652-82c5f5d4b81d of volume d64aa449-8ad9-4f68-afc1-3a485b67de82 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab1fdd-1eb2-4a70-b751-60c6fb982361]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:09 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:09 devstack sudo[113927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 Aug 26 12:19:09 devstack sudo[113927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:10 devstack sudo[113927]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82" returned: 0 in 0.345s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:10 devstack sudo[113932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d 1G Aug 26 12:19:10 devstack sudo[113932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:10 devstack sudo[113932]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d 1G" returned: 0 in 0.380s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:10 devstack sudo[113937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d Aug 26 12:19:10 devstack sudo[113937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:10 devstack sudo[113939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:19:10 devstack sudo[113939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:10 devstack sudo[113937]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d" returned: 0 in 0.299s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:10 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d is being set with open permissions: ugo+rw Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:10 devstack sudo[113944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d Aug 26 12:19:10 devstack sudo[113944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:10 devstack sudo[113939]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.259s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG oslo_service.periodic_task [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] Running periodic task VolumeManager._thread_info {{(pid=94387) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread count: 28 {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 12:19:10 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-1dc643d1-a962-403e-a947-9ce77b1cf4cc None None] thread info: [<_MainThread(MainThread, started 131766030274688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94387) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 12:19:11 devstack sudo[113944]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d" returned: 0 in 0.243s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:11 devstack sudo[113948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.info Aug 26 12:19:11 devstack sudo[113948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:11 devstack sudo[113948]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.info" returned: 0 in 0.255s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:11 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.info is being set with open permissions: ugo+rw Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:11 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.info Aug 26 12:19:11 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:11 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.info" returned: 0 in 0.240s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:11 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6fd93f5a-6e27-4d40-99ce-2400022ea4b0 tempest-ProjectReaderTests-551654951 None] Create snapshot completed successfully Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-40bf584b-d83e-4403-9652-82c5f5d4b81d-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Lock "cinder-40bf584b-d83e-4403-9652-82c5f5d4b81d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-d64aa449-8ad9-4f68-afc1-3a485b67de82" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-d64aa449-8ad9-4f68-afc1-3a485b67de82" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-40bf584b-d83e-4403-9652-82c5f5d4b81d" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-40bf584b-d83e-4403-9652-82c5f5d4b81d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Deleting offline snapshot 40bf584b-d83e-4403-9652-82c5f5d4b81d of volume d64aa449-8ad9-4f68-afc1-3a485b67de82 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] snapshot_file for this snap is: volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5489fb-7879-4861-9f93-8519b0817a64]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:11 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:12 devstack sudo[113954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d Aug 26 12:19:12 devstack sudo[113954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:12 devstack sudo[113954]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d" returned: 0 in 0.359s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:12 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d64aa449-8ad9-4f68-afc1-3a485b67de82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:19:12 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b06e13-8bbd-4d9d-9308-757ee375d2ee]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:12 devstack sudo[113959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 Aug 26 12:19:12 devstack sudo[113959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:12 devstack sudo[113959]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82" returned: 0 in 0.357s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:12 devstack sudo[113964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d Aug 26 12:19:12 devstack sudo[113964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:12 devstack sudo[113964]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d" returned: 0 in 0.327s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:12 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:12 devstack sudo[113969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d Aug 26 12:19:12 devstack sudo[113969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:13 devstack sudo[113969]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:13 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82.40bf584b-d83e-4403-9652-82c5f5d4b81d" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-40bf584b-d83e-4403-9652-82c5f5d4b81d" released by "_delete_snapshot" :: held 1.364s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-d64aa449-8ad9-4f68-afc1-3a485b67de82" released by "delete_snapshot" :: held 1.385s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:13 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Created reservations ['4df22475-5426-4095-974f-fc9845c683db', '35057d56-c6d1-4134-92ff-914dbdc4d8ee', 'ebb09a43-8399-495c-a866-c28494a9dfa8', '47d037e3-b3b7-4559-a402-9c5019530244'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:13 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Delete snapshot completed successfully. Aug 26 12:19:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-fc5fd8b7-db65-4414-8d41-f068209e9171 tempest-ProjectReaderTests-551654951 None] Lock "cinder-40bf584b-d83e-4403-9652-82c5f5d4b81d-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-d64aa449-8ad9-4f68-afc1-3a485b67de82-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:13 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Lock "cinder-d64aa449-8ad9-4f68-afc1-3a485b67de82-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-d64aa449-8ad9-4f68-afc1-3a485b67de82" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-d64aa449-8ad9-4f68-afc1-3a485b67de82" acquired by "delete_volume" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2ac409-1295-4009-9f54-bc85933115cb]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:14 devstack sudo[113973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 Aug 26 12:19:14 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:14 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82" returned: 0 in 0.357s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:14 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82 Aug 26 12:19:14 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:14 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-d64aa449-8ad9-4f68-afc1-3a485b67de82" returned: 0 in 0.245s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-d64aa449-8ad9-4f68-afc1-3a485b67de82" released by "delete_volume" :: held 0.661s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Created reservations ['bc9e76dc-160a-49d6-a46b-c9c01ffc9df4', '03ce9a4d-ed86-4e4b-9ea7-8194aed34ca3', 'f257c51b-fec3-449a-8e7b-587ec529a52a', 'd8b02bd7-8208-4438-afa4-5b679e23e792'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:14 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:14 devstack sudo[113981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:19:14 devstack sudo[113981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:15 devstack sudo[113981]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.235s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:19:15 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Deleted volume successfully. Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-8e23d7b9-ac4e-4e51-8b56-2c24cccacbf1 tempest-ProjectReaderTests-551654951 None] Lock "cinder-d64aa449-8ad9-4f68-afc1-3a485b67de82-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (9bbd9b62-dc0f-426c-8069-efeb3c87f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8520a50-8107-4ed5-8949-de2a2dce2454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8520a50-8107-4ed5-8949-de2a2dce2454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770739803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2b93bc-93a6-47ca-ad28-075ab989633e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:15Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62255508-512d-491b-9714-9ba73254edf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62255508-512d-491b-9714-9ba73254edf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a52efd-5581-4887-9ac3-729752662bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a52efd-5581-4887-9ac3-729752662bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed2b93bc-93a6-47ca-ad28-075ab989633e', 'volume_name': 'volume-ed2b93bc-93a6-47ca-ad28-075ab989633e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0276d06e-b7d3-4a1f-b2af-c877bac13fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0276d06e-b7d3-4a1f-b2af-c877bac13fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efef0cd7-df02-4633-b993-e7fa7c751af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:15 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Volume ed2b93bc-93a6-47ca-ad28-075ab989633e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed2b93bc-93a6-47ca-ad28-075ab989633e', 'volume_size': 1} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770739803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2b93bc-93a6-47ca-ad28-075ab989633e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:15Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Creating volume ed2b93bc-93a6-47ca-ad28-075ab989633e {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:19:15 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:19:15 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:15 devstack sudo[113984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e 1073741824 Aug 26 12:19:15 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:16 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e 1073741824" returned: 0 in 0.406s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:16 devstack sudo[113990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e Aug 26 12:19:16 devstack sudo[113990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:16 devstack sudo[113990]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efef0cd7-df02-4633-b993-e7fa7c751af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed2b93bc-93a6-47ca-ad28-075ab989633e', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92f62e1-9932-4fe5-be25-e12628e5ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:16 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Volume volume-ed2b93bc-93a6-47ca-ad28-075ab989633e (ed2b93bc-93a6-47ca-ad28-075ab989633e): created successfully Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92f62e1-9932-4fe5-be25-e12628e5ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (9bbd9b62-dc0f-426c-8069-efeb3c87f341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:16 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-d439537d-bacb-4a7e-80f9-2530c9fce35e tempest-ProjectReaderTests-551654951 None] Created volume successfully. Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Creating offline snapshot abed4cad-7dc6-454c-b40b-b0589a8a6dca of volume ed2b93bc-93a6-47ca-ad28-075ab989633e {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e15bd9-c6cb-4f15-b106-a465bf5563fc]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:16 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:16 devstack sudo[113993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e Aug 26 12:19:16 devstack sudo[113993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:17 devstack sudo[113993]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e" returned: 0 in 0.348s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:17 devstack sudo[113998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca 1G Aug 26 12:19:17 devstack sudo[113998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:17 devstack sudo[113998]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca 1G" returned: 0 in 0.386s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed2b93bc-93a6-47ca-ad28-075ab989633e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:17 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed2b93bc-93a6-47ca-ad28-075ab989633e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca Aug 26 12:19:17 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:17 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed2b93bc-93a6-47ca-ad28-075ab989633e -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca" returned: 0 in 0.281s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:17 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca is being set with open permissions: ugo+rw Aug 26 12:19:17 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:17 devstack sudo[114009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca Aug 26 12:19:17 devstack sudo[114009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:17 devstack sudo[114009]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca" returned: 0 in 0.237s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:18 devstack sudo[114012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.info Aug 26 12:19:18 devstack sudo[114012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:18 devstack sudo[114012]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.info" returned: 0 in 0.246s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:18 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.info is being set with open permissions: ugo+rw Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:18 devstack sudo[114015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.info Aug 26 12:19:18 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:18 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.info" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:18 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-b6a4c5b2-8adb-45f3-a564-ddcf8b03ff57 tempest-ProjectReaderTests-551654951 None] Create snapshot completed successfully Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-abed4cad-7dc6-454c-b40b-b0589a8a6dca-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Lock "cinder-abed4cad-7dc6-454c-b40b-b0589a8a6dca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-ed2b93bc-93a6-47ca-ad28-075ab989633e" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-ed2b93bc-93a6-47ca-ad28-075ab989633e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-abed4cad-7dc6-454c-b40b-b0589a8a6dca" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-abed4cad-7dc6-454c-b40b-b0589a8a6dca" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Deleting offline snapshot abed4cad-7dc6-454c-b40b-b0589a8a6dca of volume ed2b93bc-93a6-47ca-ad28-075ab989633e {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] snapshot_file for this snap is: volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cbb5bb-a7c2-4667-b263-fd4a0550b44e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:18 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:19 devstack sudo[114018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca Aug 26 12:19:19 devstack sudo[114018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:19 devstack sudo[114018]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca" returned: 0 in 0.345s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:19 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed2b93bc-93a6-47ca-ad28-075ab989633e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:19:19 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd2fe32-f76a-49dc-b602-df173a0c608d]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:19 devstack sudo[114023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e Aug 26 12:19:19 devstack sudo[114023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:19 devstack sudo[114023]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:19 devstack sudo[114028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca Aug 26 12:19:19 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:19 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca" returned: 0 in 0.335s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:19 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:19 devstack sudo[114033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca Aug 26 12:19:19 devstack sudo[114033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:20 devstack sudo[114033]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:20 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e.abed4cad-7dc6-454c-b40b-b0589a8a6dca" returned: 0 in 0.244s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-abed4cad-7dc6-454c-b40b-b0589a8a6dca" released by "_delete_snapshot" :: held 1.360s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-ed2b93bc-93a6-47ca-ad28-075ab989633e" released by "delete_snapshot" :: held 1.380s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:20 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Created reservations ['85aad3e4-451c-4e11-b1ce-3474c9733e9c', '43616411-fafa-4f5d-9d7e-397ff39fc1c6', 'edea86d5-0b63-4281-8757-64881f2d1f00', '8557e5ba-08a5-4282-9553-80a7ca40f9a7'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:20 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Delete snapshot completed successfully. Aug 26 12:19:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-796b1566-0e4a-4924-aa68-cb7cd7df1f30 tempest-ProjectReaderTests-551654951 None] Lock "cinder-abed4cad-7dc6-454c-b40b-b0589a8a6dca-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-ed2b93bc-93a6-47ca-ad28-075ab989633e-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:20 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Lock "cinder-ed2b93bc-93a6-47ca-ad28-075ab989633e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-ed2b93bc-93a6-47ca-ad28-075ab989633e" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-ed2b93bc-93a6-47ca-ad28-075ab989633e" acquired by "delete_volume" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae3111-8957-41da-868b-012bae77aedb]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:21 devstack sudo[114036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e Aug 26 12:19:21 devstack sudo[114036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:21 devstack sudo[114036]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e" returned: 0 in 0.349s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:21 devstack sudo[114041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e Aug 26 12:19:21 devstack sudo[114041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:21 devstack sudo[114041]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-ed2b93bc-93a6-47ca-ad28-075ab989633e" returned: 0 in 0.242s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-ed2b93bc-93a6-47ca-ad28-075ab989633e" released by "delete_volume" :: held 0.650s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Created reservations ['99ebf57c-a278-42ae-a96d-37ca3236e880', 'ce24da88-0e8a-4b10-a392-ffb0255286c2', 'f07c9c26-a599-45c8-acc7-c7ecddea1049', 'af0f25b8-144b-4f5e-be57-7f3cbfdec88e'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:21 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:21 devstack sudo[114044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:19:21 devstack sudo[114044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:22 devstack sudo[114044]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:19:22 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Deleted volume successfully. Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-901b34f3-0ba2-4d67-8930-4d57c92ffe16 tempest-ProjectReaderTests-551654951 None] Lock "cinder-ed2b93bc-93a6-47ca-ad28-075ab989633e-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (3b4a97c6-c914-48b4-8f87-a789a87bc0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03acdaaf-3c60-40f3-a243-750f929d9b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03acdaaf-3c60-40f3-a243-750f929d9b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427407395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc8da90-7e65-4d3f-8695-6cb24d1366f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:22Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53bcb9d-393e-4cd6-822b-b734f172f3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53bcb9d-393e-4cd6-822b-b734f172f3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735aa2d5-e8e9-4710-bbb4-ae201fbfe0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735aa2d5-e8e9-4710-bbb4-ae201fbfe0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc8da90-7e65-4d3f-8695-6cb24d1366f2', 'volume_name': 'volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbca9c96-6268-456e-b05c-0429b3d8ced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbca9c96-6268-456e-b05c-0429b3d8ced5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18525cce-f3c6-4b99-b7f0-e0d8b7a1f126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:22 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Volume adc8da90-7e65-4d3f-8695-6cb24d1366f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2', 'volume_size': 1} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427407395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc8da90-7e65-4d3f-8695-6cb24d1366f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:22Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Creating volume adc8da90-7e65-4d3f-8695-6cb24d1366f2 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:19:22 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:19:22 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:22 devstack sudo[114047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 1073741824 Aug 26 12:19:22 devstack sudo[114047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:23 devstack sudo[114047]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 1073741824" returned: 0 in 0.392s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:23 devstack sudo[114053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 Aug 26 12:19:23 devstack sudo[114053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:23 devstack sudo[114053]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2" returned: 0 in 0.245s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18525cce-f3c6-4b99-b7f0-e0d8b7a1f126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17c9877-82af-4a43-a4ec-acc3fd5b5b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:23 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Volume volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 (adc8da90-7e65-4d3f-8695-6cb24d1366f2): created successfully Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17c9877-82af-4a43-a4ec-acc3fd5b5b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (3b4a97c6-c914-48b4-8f87-a789a87bc0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:23 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-f6363780-fd2b-4ef4-bf00-03b4fc6db5b8 tempest-ProjectReaderTests-551654951 None] Created volume successfully. Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Creating offline snapshot 0e9eee5e-cb6b-4855-acdc-b17c51113777 of volume adc8da90-7e65-4d3f-8695-6cb24d1366f2 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b42a78-a64c-4e5a-a694-cb076e36794b]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:23 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:23 devstack sudo[114056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 Aug 26 12:19:23 devstack sudo[114056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:24 devstack sudo[114056]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2" returned: 0 in 0.348s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:24 devstack sudo[114061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 1G Aug 26 12:19:24 devstack sudo[114061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:24 devstack sudo[114061]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 1G" returned: 0 in 0.381s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:24 devstack sudo[114066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 Aug 26 12:19:24 devstack sudo[114066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:24 devstack sudo[114066]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777" returned: 0 in 0.283s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:24 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 is being set with open permissions: ugo+rw Aug 26 12:19:24 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:24 devstack sudo[114071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 Aug 26 12:19:24 devstack sudo[114071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:25 devstack sudo[114071]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777" returned: 0 in 0.245s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:25 devstack sudo[114074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.info Aug 26 12:19:25 devstack sudo[114074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:25 devstack sudo[114074]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.info" returned: 0 in 0.244s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:25 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.info is being set with open permissions: ugo+rw Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:25 devstack sudo[114077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.info Aug 26 12:19:25 devstack sudo[114077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:25 devstack sudo[114077]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.info" returned: 0 in 0.239s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:25 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-08d4baae-f949-417e-af6e-191a21ff527d tempest-ProjectReaderTests-551654951 None] Create snapshot completed successfully Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-0e9eee5e-cb6b-4855-acdc-b17c51113777-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Lock "cinder-0e9eee5e-cb6b-4855-acdc-b17c51113777-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-adc8da90-7e65-4d3f-8695-6cb24d1366f2" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-adc8da90-7e65-4d3f-8695-6cb24d1366f2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-0e9eee5e-cb6b-4855-acdc-b17c51113777" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-0e9eee5e-cb6b-4855-acdc-b17c51113777" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Deleting offline snapshot 0e9eee5e-cb6b-4855-acdc-b17c51113777 of volume adc8da90-7e65-4d3f-8695-6cb24d1366f2 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] snapshot_file for this snap is: volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[633733c8-a2ec-4fb1-a0b1-8325c73a10d6]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:25 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:26 devstack sudo[114080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 Aug 26 12:19:26 devstack sudo[114080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:26 devstack sudo[114080]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:26 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:19:26 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f8a5c9-c39a-4a8f-a717-0ade59c47145]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:26 devstack sudo[114086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 Aug 26 12:19:26 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:26 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:26 devstack sudo[114091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 Aug 26 12:19:26 devstack sudo[114091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:26 devstack sudo[114091]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777" returned: 0 in 0.335s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:26 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:27 devstack sudo[114096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777 Aug 26 12:19:27 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:27 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:27 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2.0e9eee5e-cb6b-4855-acdc-b17c51113777" returned: 0 in 0.249s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-0e9eee5e-cb6b-4855-acdc-b17c51113777" released by "_delete_snapshot" :: held 1.370s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-adc8da90-7e65-4d3f-8695-6cb24d1366f2" released by "delete_snapshot" :: held 1.389s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:27 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Created reservations ['acdbe67c-0b66-4208-947a-7ea81f191647', '35ea02d2-1a03-4be1-b5e0-6c0976773e1f', '1681fd2a-f10b-4373-a793-38b3987f4b6b', '80b56d1f-a30b-47f3-9d06-ae607f1c5e96'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:27 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Delete snapshot completed successfully. Aug 26 12:19:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-a3a412f0-a2e4-49f0-8578-eb5e60cc0691 tempest-ProjectReaderTests-551654951 None] Lock "cinder-0e9eee5e-cb6b-4855-acdc-b17c51113777-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-adc8da90-7e65-4d3f-8695-6cb24d1366f2-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:27 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Lock "cinder-adc8da90-7e65-4d3f-8695-6cb24d1366f2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-adc8da90-7e65-4d3f-8695-6cb24d1366f2" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-adc8da90-7e65-4d3f-8695-6cb24d1366f2" acquired by "delete_volume" :: waited 0.014s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4eb2ad-9654-4eb0-9ed8-c41da9edcec5]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:28 devstack sudo[114099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 Aug 26 12:19:28 devstack sudo[114099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:28 devstack sudo[114099]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2" returned: 0 in 0.353s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:28 devstack sudo[114104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2 Aug 26 12:19:28 devstack sudo[114104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:28 devstack sudo[114104]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-adc8da90-7e65-4d3f-8695-6cb24d1366f2" returned: 0 in 0.241s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-adc8da90-7e65-4d3f-8695-6cb24d1366f2" released by "delete_volume" :: held 0.649s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Created reservations ['2ccc0bdd-99e9-450d-b233-2c83a7ded905', 'd4bb24f5-431b-4730-83c1-e2e8336a5fe3', '84925d1f-9c45-4662-9432-717e5be81187', '58b45598-1798-4208-a668-4a02f61dab4a'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:28 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:28 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:19:28 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:29 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.237s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:19:29 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Deleted volume successfully. Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-3c418629-78c5-44c9-8aad-dff12d2183fb tempest-ProjectReaderTests-551654951 None] Lock "cinder-adc8da90-7e65-4d3f-8695-6cb24d1366f2-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94387) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (aca1c00f-dc9d-4915-ad95-290ce0d9f353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb257094-437a-498e-b210-27f41a33c67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb257094-437a-498e-b210-27f41a33c67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778148190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a47961b-6a38-4543-be46-5a2952afd324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:30Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac113313-39f1-4b41-ad37-2ae2cdc26c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac113313-39f1-4b41-ad37-2ae2cdc26c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0142b4f-3e08-4311-824f-a41545b12e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0142b4f-3e08-4311-824f-a41545b12e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a47961b-6a38-4543-be46-5a2952afd324', 'volume_name': 'volume-3a47961b-6a38-4543-be46-5a2952afd324', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d820ef41-743f-4424-a745-f38219bdf680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d820ef41-743f-4424-a745-f38219bdf680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464a9909-2648-41cb-8c56-fe032e1f7102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:29 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Volume 3a47961b-6a38-4543-be46-5a2952afd324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a47961b-6a38-4543-be46-5a2952afd324', 'volume_size': 1} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T10:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778148190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a47961b-6a38-4543-be46-5a2952afd324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4226c28a5b4cdc9db7b8c16f38ff8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T10:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T10:19:30Z,use_quota=True,user_id='4095d2965097456aa2811521bc47b2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f04d506-b71f-4e1b-9630-d8a58c399e20),volume_type_id=7f04d506-b71f-4e1b-9630-d8a58c399e20)}" {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Creating volume 3a47961b-6a38-4543-be46-5a2952afd324 {{(pid=94387) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Selected osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d as target Quobyte volume. {{(pid=94387) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 12:19:29 devstack cinder-volume[94387]: INFO cinder.volume.drivers.remotefs [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] casted to osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d Aug 26 12:19:29 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 1073741824 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:29 devstack sudo[114110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 1073741824 Aug 26 12:19:29 devstack sudo[114110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:30 devstack sudo[114110]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 1073741824" returned: 0 in 0.409s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:30 devstack sudo[114115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 Aug 26 12:19:30 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:30 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324" returned: 0 in 0.245s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'} {{(pid=94387) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464a9909-2648-41cb-8c56-fe032e1f7102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a47961b-6a38-4543-be46-5a2952afd324', 'volume_size': 1}' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f3628a-9b41-4124-8d28-51ee079eafdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 12:19:30 devstack cinder-volume[94387]: INFO cinder.volume.flows.manager.create_volume [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Volume volume-3a47961b-6a38-4543-be46-5a2952afd324 (3a47961b-6a38-4543-be46-5a2952afd324): created successfully Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f3628a-9b41-4124-8d28-51ee079eafdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94387) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Flow 'volume_create_manager' (aca1c00f-dc9d-4915-ad95-290ce0d9f353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94387) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 12:19:30 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-40a30a5f-9be5-48c7-9590-47b001cdb497 tempest-ProjectReaderTests-551654951 None] Created volume successfully. Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Creating offline snapshot 3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 of volume 3a47961b-6a38-4543-be46-5a2952afd324 {{(pid=94387) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb72d04-ca77-4ba4-8f14-ab2a85b3cfa4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:30 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:30 devstack sudo[114118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 Aug 26 12:19:30 devstack sudo[114118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:31 devstack sudo[114118]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324" returned: 0 in 0.348s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 1G {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:31 devstack sudo[114123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 1G Aug 26 12:19:31 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:31 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 1G" returned: 0 in 0.385s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a47961b-6a38-4543-be46-5a2952afd324 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:31 devstack sudo[114129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a47961b-6a38-4543-be46-5a2952afd324 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 Aug 26 12:19:31 devstack sudo[114129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:31 devstack sudo[114129]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a47961b-6a38-4543-be46-5a2952afd324 -F qcow2 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4" returned: 0 in 0.300s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:31 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 is being set with open permissions: ugo+rw Aug 26 12:19:31 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:31 devstack sudo[114134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 Aug 26 12:19:31 devstack sudo[114134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:32 devstack sudo[114134]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:32 devstack sudo[114137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.info Aug 26 12:19:32 devstack sudo[114137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:32 devstack sudo[114137]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.info" returned: 0 in 0.248s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:32 devstack cinder-volume[94387]: WARNING cinder.volume.drivers.remotefs [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.info is being set with open permissions: ugo+rw Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.info {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:32 devstack sudo[114140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.info Aug 26 12:19:32 devstack sudo[114140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:32 devstack sudo[114140]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.info" returned: 0 in 0.238s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:32 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-dd935d10-4513-40de-b3f5-d352ad5859d5 tempest-ProjectReaderTests-551654951 None] Create snapshot completed successfully Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4-delete_snapshot" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Lock "cinder-3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-3a47961b-6a38-4543-be46-5a2952afd324" by "delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-3a47961b-6a38-4543-be46-5a2952afd324" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4" by "_delete_snapshot" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Deleting offline snapshot 3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 of volume 3a47961b-6a38-4543-be46-5a2952afd324 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] snapshot_file for this snap is: volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 {{(pid=94387) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2ae4b0-cb7a-4aab-ad1e-92eb191ce29e]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:32 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:33 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 Aug 26 12:19:33 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:33 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4" returned: 0 in 0.357s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:33 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.remotefs [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a47961b-6a38-4543-be46-5a2952afd324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94387) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 12:19:33 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa1808-4b53-494a-bf4f-9bdd994030c4]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:33 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 Aug 26 12:19:33 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:33 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324" returned: 0 in 0.358s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:33 devstack sudo[114153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 Aug 26 12:19:33 devstack sudo[114153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:33 devstack sudo[114153]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4" returned: 0 in 0.337s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:33 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:34 devstack sudo[114158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4 Aug 26 12:19:34 devstack sudo[114158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:34 devstack sudo[114158]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:34 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324.3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4" returned: 0 in 0.243s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4" released by "_delete_snapshot" :: held 1.384s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-3a47961b-6a38-4543-be46-5a2952afd324" released by "delete_snapshot" :: held 1.407s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:34 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Created reservations ['ae28a5ca-200f-447f-b2e3-dffb7521b416', '5562e9e2-feb0-4d94-8b8b-69aa8ba6217a', 'f6fb725b-513d-4352-a29a-5e2a7f642202', '5f9369f9-f38b-43ba-97b6-3d34f4537500'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:34 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Delete snapshot completed successfully. Aug 26 12:19:34 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-6b0e66e8-ae4c-4288-adef-c7e9f060f149 tempest-ProjectReaderTests-551654951 None] Lock "cinder-3bdfb405-7ffd-4aca-8afc-f05e4b8cd3c4-delete_snapshot" released by "delete_snapshot" :: held 1.549s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-3a47961b-6a38-4543-be46-5a2952afd324-delete_volume" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Lock "cinder-3a47961b-6a38-4543-be46-5a2952afd324-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=114,cinder:INSERT=39,cinder:UPDATE=129,cinder:DELETE=8 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=110,cinder:INSERT=41,cinder:UPDATE=159,cinder:DELETE=16 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Acquiring lock "cinder-quobyte-3a47961b-6a38-4543-be46-5a2952afd324" by "delete_volume" {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-3a47961b-6a38-4543-be46-5a2952afd324" acquired by "delete_volume" :: waited 0.020s {{(pid=94387) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dd8d5e-0297-4a77-8313-b5e0275679da]: (4, 'qcow2') {{(pid=95605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:35 devstack sudo[114197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 Aug 26 12:19:35 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:35 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324" returned: 0 in 0.347s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:35 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324 Aug 26 12:19:35 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:35 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8/volume-3a47961b-6a38-4543-be46-5a2952afd324" returned: 0 in 0.256s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Lock "cinder-quobyte-3a47961b-6a38-4543-be46-5a2952afd324" released by "delete_volume" :: held 0.657s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG cinder.quota [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Created reservations ['6668971e-b578-4013-8c4a-3eb6df3d8008', '3fbeade1-484a-41cd-8de3-578d1a07b55e', '73628ab9-f983-48ed-9850-291f689acbd9', 'b0d866e9-7fd4-485e-ac3a-9ac9cabc8d08'] {{(pid=94387) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d': None} {{(pid=94387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG cinder.volume.drivers.quobyte [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-469ff119-fadf-4fbd-9168-b8b48211cf3d'] {{(pid=94387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.lockutils [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 12:19:35 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 12:19:35 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8 Aug 26 12:19:35 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 12:19:36 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Aug 26 12:19:36 devstack cinder-volume[94387]: DEBUG oslo_concurrency.processutils [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/935c9057d6b8df66941dae302e31d2d8" returned: 0 in 0.251s {{(pid=94387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 12:19:36 devstack cinder-volume[94387]: DEBUG cinder.manager [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Notifying Schedulers of capabilities ... {{(pid=94387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 12:19:36 devstack cinder-volume[94387]: INFO cinder.volume.manager [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Deleted volume successfully. Aug 26 12:19:36 devstack cinder-volume[94387]: DEBUG cinder.coordination [None req-c9e7adf1-d80f-4819-bef3-0a880ab08442 tempest-ProjectReaderTests-551654951 None] Lock "cinder-3a47961b-6a38-4543-be46-5a2952afd324-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=94387) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 12:19:45 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 12:19:46 devstack cinder-volume[94387]: DEBUG dbcounter [-] [94387] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=94387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}